-- Logs begin at Fri 2022-09-23 13:06:19 UTC, end at Fri 2022-09-23 14:17:40 UTC. -- Sep 23 13:40:13.466483 dv-cinder-857434-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 23 13:40:13.475214 dv-cinder-857434-4-smb devstack@keystone.service[81851]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 13:40:13 2022] *** Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: nodename: dv-cinder-857434-4-smb Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: machine: x86_64 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: clock source: unix Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: pcre jit disabled Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: detected number of CPU cores: 4 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: current working directory: / Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: detected binary path: /usr/bin/uwsgi-core Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: your processes number limit is 47680 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: your memory page size is 4096 bytes Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: detected max file descriptor number: 2048 Sep 23 13:40:13.477377 dv-cinder-857434-4-smb devstack@keystone.service[81851]: lock engine: pthread robust mutexes Sep 23 13:40:13.478121 dv-cinder-857434-4-smb devstack@keystone.service[81851]: thunder lock: enabled Sep 23 13:40:13.478121 dv-cinder-857434-4-smb devstack@keystone.service[81851]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 23 13:40:13.478121 dv-cinder-857434-4-smb devstack@keystone.service[81851]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 13:40:13.517569 dv-cinder-857434-4-smb devstack@keystone.service[81851]: Python main interpreter initialized at 0x55b2e84a99c0 Sep 23 13:40:13.517569 dv-cinder-857434-4-smb devstack@keystone.service[81851]: python threads support enabled Sep 23 13:40:13.517569 dv-cinder-857434-4-smb devstack@keystone.service[81851]: your server socket listen backlog is limited to 100 connections Sep 23 13:40:13.517569 dv-cinder-857434-4-smb devstack@keystone.service[81851]: your mercy for graceful operations on workers is 90 seconds Sep 23 13:40:13.517886 dv-cinder-857434-4-smb devstack@keystone.service[81851]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 13:40:13.517989 dv-cinder-857434-4-smb devstack@keystone.service[81851]: *** Operational MODE: preforking *** Sep 23 13:40:13.518265 dv-cinder-857434-4-smb devstack@keystone.service[81851]: *** uWSGI is running in multiple interpreter mode *** Sep 23 13:40:13.518265 dv-cinder-857434-4-smb devstack@keystone.service[81851]: spawned uWSGI master process (pid: 81851) Sep 23 13:40:13.518454 dv-cinder-857434-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 23 13:40:13.520925 dv-cinder-857434-4-smb devstack@keystone.service[81851]: spawned uWSGI worker 1 (pid: 81863, cores: 1) Sep 23 13:40:13.520925 dv-cinder-857434-4-smb devstack@keystone.service[81851]: spawned uWSGI worker 2 (pid: 81864, cores: 1) Sep 23 13:40:13.520925 dv-cinder-857434-4-smb devstack@keystone.service[81851]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 13:40:17.894231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:40:17.894231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 23 13:40:17.895018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:40:17.895018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: from cryptography.utils import int_from_bytes Sep 23 13:40:17.896009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:40:17.896009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: from cryptography.utils import int_from_bytes Sep 23 13:40:17.896496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 13:40:17.896496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: from cryptography.utils import int_from_bytes Sep 23 13:40:17.946889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 13:40:17.947068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 13:40:17.947149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 13:40:17.947245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] command line args: [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 13:40:17.947328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 13:40:17.947508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] command line args: [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 13:40:17.947593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 13:40:17.947670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ================================================================================ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 13:40:17.947784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 13:40:17.947936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] admin_token = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ================================================================================ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 13:40:17.948197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_dir = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_dir = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] config_source = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] debug = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] config_source = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.948955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] debug = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.949986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_config_append = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_config_append = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_dir = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.950905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_dir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.951960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.952974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.953930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.954932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] publish_errors = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] publish_errors = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.955910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] standard_threads = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] standard_threads = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.956969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_journal = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_journal = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_json = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_json = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_stderr = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_stderr = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] use_syslog = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] use_syslog = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.957949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.958039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 13:40:17.958207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.958998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.959905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.960993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.961955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.962962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.963893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.964950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.965890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.966880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.967834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.968929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.969933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.970972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.971872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.972975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.973927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.974871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.975843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.976848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.977958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.978978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.979964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.980929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.981957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.982889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.983901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.external = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.984932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.password = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] auth.token = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.985924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.986929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.987962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.988038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.988108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.988177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.988247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.988316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.external = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.993937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.password = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] auth.token = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.994934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.995929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.996969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.997988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.998975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:17.999938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.000955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.001894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.002929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.003879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.004847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.005968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.006104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.006217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.006341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.006508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.007984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.008940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.009939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.010870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.011879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.012985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.013941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.014877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.015855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.020980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.021978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.022918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.023952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.024981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.025941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.026967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.027947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.028949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.029888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.030875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.031970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.032903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.033917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.034837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.035822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.036927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.037852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.038882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.039011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.039211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.039597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.039719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.039845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.040901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 13:40:18.041399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.041872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.042107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.042232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.042477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.042718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 13:40:18.042889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81863) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 13:40:18.070440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.070667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.070889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.072184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.072421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.072649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.079190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.080979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.109291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.109523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.109694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.109929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.168026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.168268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.224088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.224319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.224411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.224606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.385431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.385646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.385873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.386960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.387210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.387371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.387585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.413536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.413663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.413772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.413850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.413993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.414915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.415001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.415126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.415208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.426141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.426658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.442945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81863) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.443807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.444072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81864) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 23 13:40:18.460151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.460358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 13:40:18.460706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.460850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.460965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 13:40:18.461067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 13:40:18.461167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.461499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.461629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.461733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.461832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 23 13:40:18.461933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.462032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.462209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.462475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.462740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.471492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.471770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.472067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.472351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.472562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.472848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.473122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.475901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.479952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.481177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.482862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.483132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.483417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.483702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.484290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.484868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.485874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.486153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.486427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.486703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.486977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.508797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.510260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.510545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.510791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.512318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.512621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.515220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.515504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.515787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.517350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.517646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.517932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.522183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.522468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.524703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.524997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.528126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.528425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.528715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.528999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.529272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.529544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.529821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.530091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.530723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.531095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.531400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.531695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.532002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.532289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.532568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.532845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.546417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.546853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.549525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.549811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.550575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.554292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.554475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.554680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.557635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.557936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.558915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.562076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.562178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.565250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.565338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.565551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.565835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.566120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.566397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.566679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.568627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.568965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.569257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.569546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.569825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.570108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.582277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.582563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.582828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.583089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.586205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.586561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.586885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.587212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.589931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.591447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.592987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.593260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.594216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.595776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.595991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.596280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.596575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.596865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.597248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.597463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.597745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.601012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.601304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.601599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.601924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.602315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.608994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.609954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.609954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.609954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.610183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.610463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.610746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.613679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.613969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.614253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.614537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.614974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.615248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.615534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.626702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.629619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.632927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.633015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.634027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.634797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.635504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.635787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.636205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.637746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.639284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.640804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.641096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.641499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.642557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.644051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.646923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.647456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.647873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.648122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.648305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.649607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.652557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.652959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.653252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.653539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.656231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.656621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.656891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.661503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.661796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.662082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.664566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81863) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.664932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.665213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.665490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.665764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.666036 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.666318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.666599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.666865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.667141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.667418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.667688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.667974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.668242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81863) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.669977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81864) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 23 13:40:18.670269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.670556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.670837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.671147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.671443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.671725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.672030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.672306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.672685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.672966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.673243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.673514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.673802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81864) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 23 13:40:18.703022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b2e84a99c0 pid: 81863 (default app) Sep 23 13:40:18.706309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39d3f-8681-40ac-8eb0-c3f0e3cea52c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:18.706595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39d3f-8681-40ac-8eb0-c3f0e3cea52c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:18.706866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39d3f-8681-40ac-8eb0-c3f0e3cea52c None None] PATH_INFO: `/v3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:18.709419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b2e84a99c0 pid: 81864 (default app) Sep 23 13:40:18.711530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Sep 23 13:40:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:26.436865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:26.437398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:26.437398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:26.441856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:40:26.447175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:26.454727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:26.454727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:26.518093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: INFO dbcounter [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] Registered counter for database keystone Sep 23 13:40:26.538094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG oslo_db.sqlalchemy.engines [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81863) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:40:26.544591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writer thread running {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:40:26.722927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81863) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 13:40:26.723255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG passlib.handlers.bcrypt [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81863) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 13:40:26.780709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:26.782313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:26.908086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 23 13:40:27.358045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:27.426798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: INFO dbcounter [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] Registered counter for database keystone Sep 23 13:40:27.448236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG oslo_db.sqlalchemy.engines [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 13:40:27.454263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writer thread running {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 13:40:27.571759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837eafd3-4d5b-4c74-b066-af3f2735f355 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:27.575974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:27.576593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:27.576871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:27.577138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:27.585231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:27.637168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 13:40:27.637457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ba71-e889-48a5-93f0-1ddf385dba85 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:27.646627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Sep 23 13:40:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 13:40:27.652587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:27.669768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9094f5-a219-46fc-92c9-622e49b5c2e7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:27.674130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:27.675224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:27.675507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:27.675779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] PATH_INFO: `/v3/projects/9de1115a66a14d16b7a8fe9cccd73591` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:27.677401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] RBAC: Authorizing `identity:get_project(project_id=9de1115a66a14d16b7a8fe9cccd73591)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:27.731166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 23 13:40:27.731512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48acec-5762-4dc0-8352-63fcca6ffc96 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:27.736085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Sep 23 13:40:27 2022] GET /identity/v3/projects/9de1115a66a14d16b7a8fe9cccd73591 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:29.853426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d4bd-1bb3-48f6-aaa9-a6cf978fb9a5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:29.853931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d4bd-1bb3-48f6-aaa9-a6cf978fb9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:29.854013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d4bd-1bb3-48f6-aaa9-a6cf978fb9a5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:29.858129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:29.863590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:29.864090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:29.864177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:29.884181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:29.885724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:29.893376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 23 13:40:30.156538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d4bd-1bb3-48f6-aaa9-a6cf978fb9a5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:30.168953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d4bd-1bb3-48f6-aaa9-a6cf978fb9a5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:30.173074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:30.173674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:30.173954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:30.174228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:30.182249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:30.184051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9db3d-db00-46c2-ace4-2d439aa55747 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:30.192546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Sep 23 13:40:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 13:40:30.198379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:30.207378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f51a1-565c-4026-84f6-f04f8d8f35be None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:30.211694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:30.212347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:30.212632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:30.212912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:30.217369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:30.217369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343a0fb-90d4-4266-af65-8c79f11c0535 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:30.217571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Sep 23 13:40:30 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:32.413543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a885e5-27b4-4d15-a99a-dd1145344c5d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:32.414107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a885e5-27b4-4d15-a99a-dd1145344c5d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:32.414107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a885e5-27b4-4d15-a99a-dd1145344c5d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:32.415691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:32.421079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:32.421514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:32.421637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:32.439186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb141-07c2-4211-b50e-95ccf22dfd10 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:32.439445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:32.439545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb141-07c2-4211-b50e-95ccf22dfd10 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:32.439726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bdb141-07c2-4211-b50e-95ccf22dfd10 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:32.440664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:32.441066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:40:32.446125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:32.446408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:32.446683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:32.489054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG passlib.handlers.bcrypt [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81864) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 23 13:40:32.489450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG passlib.handlers.bcrypt [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81864) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 23 13:40:32.520834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:32.538775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:32.540639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:32.637050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:32.787216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:32.812641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:32.891408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda6737-3dee-4082-812e-ba38896ec2a9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:32.900048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:32.925874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:32.926518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:32.926795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:32.927070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:32.938975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:32.948159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:32.949250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:32.950242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:32.955275 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.001023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29029e38-f50f-4928-92f9-b7bb89863266 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.003303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.035534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.039141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.040386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.040729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.041279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.054881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae262a5-032f-4492-9966-3b7b999d4776 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.089506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.090125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.090408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.090684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.091346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:33.091648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.093087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.105026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:33.107290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.108860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.110553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.204936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:40:33.210058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af50b7-11c5-468a-b210-032b5a49a417 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.210953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.213669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.244458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.245097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.245381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.245664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.246812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.248312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.249887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:33 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:33.255197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.269723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.308315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55eea9-aa62-473f-a9d4-80728d61a502 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.342516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.343368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.343646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.343950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.354265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec986-966d-4bf5-a8f0-c2344830172c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.362105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.363663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:40:33.382521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:33.383623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:40:33.384624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:40:33.384624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:40:33.384624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:33.384624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:40:33.389357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.389476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.389988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.390267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.390534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.391632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.393163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.394676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:33.400900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:33.450086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.482117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:33.500529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e6473-4f73-46b7-9a8b-86b78858eb37 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.501083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306744d-c80e-457b-90a1-b2aebe2603db None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:33.535437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.535635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:33.536081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.536193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:33.536361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.536464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:33.536634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.536724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:33.537274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:33.537412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.domain.id=default, user.id=858f2104639a431f8850986398647589) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:33.537635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.537727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:33.539048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20d858-a222-4067-b053-60e3e27479c9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.539199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e4868-e372-42bd-9eed-fbd475ca1035 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:33.546058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Sep 23 13:40:33 2022] GET /identity/v3/role_assignments?user.id=858f2104639a431f8850986398647589&scope.domain.id=default&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:33.557153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:36.057295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215c61-b0ad-4eaa-beb4-70e61b693475 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.057832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215c61-b0ad-4eaa-beb4-70e61b693475 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.057832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a215c61-b0ad-4eaa-beb4-70e61b693475 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.059495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:36.064855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf714-3743-4b30-a4c8-23a3f434f9c1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.065300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf714-3743-4b30-a4c8-23a3f434f9c1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.065473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cf714-3743-4b30-a4c8-23a3f434f9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-af6cf714-3743-4b30-a4c8-23a3f434f9c1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:36.090171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-af6cf714-3743-4b30-a4c8-23a3f434f9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:36.142171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d36e8-1f0c-46fb-9722-58571b3be15e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.142171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d36e8-1f0c-46fb-9722-58571b3be15e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.142434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d36e8-1f0c-46fb-9722-58571b3be15e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.144153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 13/23] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:36.159531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9314e8b-2bd2-488c-9de1-516783a191b7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.159820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9314e8b-2bd2-488c-9de1-516783a191b7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.160137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9314e8b-2bd2-488c-9de1-516783a191b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.170295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 11/24] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:36.185572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9314e8b-2bd2-488c-9de1-516783a191b7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:36.187067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9314e8b-2bd2-488c-9de1-516783a191b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:36.273556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:36.492563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b5bd-5f8e-4656-8185-a46a82eb356c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.493203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b5bd-5f8e-4656-8185-a46a82eb356c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.493684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b5bd-5f8e-4656-8185-a46a82eb356c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.495232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 12/26] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:36.505699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.506798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.507263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.536922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:36.538466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:36.575194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57708-a145-4359-857d-b7622175a6b6 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.575815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57708-a145-4359-857d-b7622175a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.576326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57708-a145-4359-857d-b7622175a6b6 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.577910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:36.583565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.584157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.585139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.615208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:36.616460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:36.643742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:36.644605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:36.653164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:36.706017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:36.754175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 14/29] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:36.755170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:36.805136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654f978-8cd4-4f66-be83-3ae2a57222ee None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:36.889919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:36.890563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:36.890845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:36.891121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:36.913821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:36.915848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:40:36.936682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:36.937632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:40:36.938409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:40:36.938409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:40:36.938409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:36.940349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:36.941818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:36.990072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a7b22-784d-453d-837a-6056e1dbcb2b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.012141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:37.064984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.066372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.066897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.067357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.080707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:37.082361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9466c-5382-4f08-9eed-66e2bedbe854 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:37.088118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:37.088932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:37.089678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:37.092214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 15/31] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:37.093314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.120734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.121351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.121632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.121903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.122574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.124259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.132019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:37.195599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ab865-8e5a-4cfe-a9db-584c9075dda4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.228441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.229051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.229331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.229603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.230252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:37.230553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.231940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.246531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 16/32] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:37.247579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.346077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:37.352654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481e6fb-02f0-4c20-a903-84872d0dc531 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.363371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 17/33] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 13:40:36 2022] POST /identity/v3/roles => generated 219 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:37.364484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.396793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.397917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.398689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.399415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.400295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.402782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.508694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e561dd-bf3b-4a2b-96c9-b2e97681cdc6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.539867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:37.572877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.573477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.573806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.574105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.574776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:37.575080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.578253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.594537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:37.595805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.627203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 17/35] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 13:40:37 2022] POST /identity/v3/roles => generated 225 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:37.628268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.780868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6782c5dc-0975-4868-9fc5-bb61ee7b3d8b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.830616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.831252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.831534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.831808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.832357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9864c88-3165-422d-8eec-ce572f49ecea None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:37.832534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.834054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a1407-4a68-4335-b381-b455f92e0445 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.872257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:37.872909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.875561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.875561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.875561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:37.876778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550bf51-c426-4ec9-8fef-c7dff3b55c52 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:37.878718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 18/36] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:37 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:37.879685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477c1e-251d-4a23-a8af-2bfcc8410010 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.880003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477c1e-251d-4a23-a8af-2bfcc8410010 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.880293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477c1e-251d-4a23-a8af-2bfcc8410010 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.882099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 19/37] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:37.887028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477c1e-251d-4a23-a8af-2bfcc8410010 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:37.914250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:37.968023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 19/38] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:40:37 2022] POST /identity/v3/projects => generated 301 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:37.968023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec5b9-d7d4-4b8b-bb45-d77bb0e997e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:37.968023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec5b9-d7d4-4b8b-bb45-d77bb0e997e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:37.968023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ec5b9-d7d4-4b8b-bb45-d77bb0e997e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:37.986855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9f8ec5b9-d7d4-4b8b-bb45-d77bb0e997e6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:37.988831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9f8ec5b9-d7d4-4b8b-bb45-d77bb0e997e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:38.016755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477c1e-251d-4a23-a8af-2bfcc8410010 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:38.024326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:38.060252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:38.061119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.061228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.061554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.063070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:38.064924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:38.072103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 20/39] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:38.075016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:38.097866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 20/40] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:38.121942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5cdd7-cfd9-4df5-80e3-0386cb61f820 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.122127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5cdd7-cfd9-4df5-80e3-0386cb61f820 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.122392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5cdd7-cfd9-4df5-80e3-0386cb61f820 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.123763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 21/41] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:40:38.129394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.129647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.129867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.194447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955b41c3-06ce-40af-a8c6-145fd9dfe480 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:38.197191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:38.235359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:38.236574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.237056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.237557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] PATH_INFO: `/v3/domains/default/users/858f2104639a431f8850986398647589/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.241648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=858f2104639a431f8850986398647589, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:38.243384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:38.257825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:38.259023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:38.324500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:38.379571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:38.383054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Sep 23 13:40:38 2022] PUT /identity/v3/domains/default/users/858f2104639a431f8850986398647589/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:38.490846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:38.501703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f565f36-0899-4767-b67b-b6098b2e8a88 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:38.540806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:38.541434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.541720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.542057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.542746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:38.544192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:38.590200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:38.658079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 13:40:38 2022] POST /identity/v3/roles => generated 223 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:40:38.691828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96192170-445d-45cc-a755-73ace1c43b39 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:38.728318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:38.728977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.729258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.729533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.730666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:38.732158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd487f60-d158-4c38-bcdb-3f65a6428f5d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:38.733754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 22/45] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:38.739528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:38.852170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12f34d-8843-467a-888b-8faf839ab1c6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:38.887416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:38.888080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:38.888369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:38.888645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:38.889320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:38.890773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76f043-dc76-4f88-a7bf-8d2bc24ce4c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:38.988374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:40:38 2022] POST /identity/v3/projects => generated 312 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:40.541329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0f44-6037-4f41-b968-f99bd73dbea9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:40.541835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0f44-6037-4f41-b968-f99bd73dbea9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:40.541918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb0f44-6037-4f41-b968-f99bd73dbea9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:40.543238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:40.548731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:40.549135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:40.549292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:40.555531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:40.567541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:40.568831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:40.638175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:40.906774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0f44-6037-4f41-b968-f99bd73dbea9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:40.928839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.009667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb0f44-6037-4f41-b968-f99bd73dbea9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.046480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.047118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.047402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.047683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.057628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8db06b23-857b-408b-bec4-4d5d3e566c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:41.062519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:41.063483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:41.064391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:41.069830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.123421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca3ce-4bec-480c-bac9-c410af6ebaba None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.123711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca3ce-4bec-480c-bac9-c410af6ebaba None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.124018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ca3ce-4bec-480c-bac9-c410af6ebaba None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.125366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 25/50] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:40:41.130109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.130400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.130680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.149319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:41.150847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:41.168147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8de3b-b4cb-4b81-9609-44211837174a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.199368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.204335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.204951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.210333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.210333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.210333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:41.210333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.210333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.216104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 26/51] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:41.220089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 26/52] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:41.221721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.320327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e65a5d-3669-41de-b91a-e1434424707b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.352805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.353437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.353720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.353995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.355125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.356620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.358307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:41 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:41.363791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.376071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.462823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eb631-997b-4e42-977a-1cb4387f8016 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.486285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.497665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.498309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.498594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.498869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.499998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.501451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.503021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 27/54] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:41.509449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.549517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.592829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed877526-f31a-466f-bf90-f37a4ef0e0a4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.631183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.632003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.632291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.632577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.633773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.635247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.637096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 28/55] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:41.642684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:41.691734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.714822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128b6b-ab90-45df-807c-51b2dfef9d83 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.743046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d660f-e02c-401e-aa58-1f6b8bdf17ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:41.748581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.749188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.749470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.749745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.750468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.domain.id=default, user.id=858f2104639a431f8850986398647589) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:41.750773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.752232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57a003-63f6-46d9-8a66-4f9c807b6cab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.760650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 28/56] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Sep 23 13:40:41 2022] GET /identity/v3/role_assignments?user.id=858f2104639a431f8850986398647589&scope.domain.id=default&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 530 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:41.773161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:41.779692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:41.780346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:41.780631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:41.780906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:41.781584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:41.784504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadaebb-fbb9-4c5a-bcfa-ad9ea43ae5c9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:41.867537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 29/57] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Sep 23 13:40:41 2022] POST /identity/v3/projects => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:40:43.993005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0d0b-9a4a-493a-ad67-eaa1b4786db7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:43.993522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0d0b-9a4a-493a-ad67-eaa1b4786db7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:43.993630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd0d0b-9a4a-493a-ad67-eaa1b4786db7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:43.994912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 29/58] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:43.999938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:44.000303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:44.000521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:44.018497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:44.019682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:44.082967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:44.346404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0d0b-9a4a-493a-ad67-eaa1b4786db7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:44.444668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd0d0b-9a4a-493a-ad67-eaa1b4786db7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:44.476982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:44.477614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:44.477899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:44.478179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:44.479304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:44.480779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c07bf-9b75-4729-805b-d095294c7bbd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:44.482378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 30/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:44.487723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:44.582484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aafc46a-bc14-485a-98c3-151de3ab74b6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:44.594780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:44.614906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:44.616051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:44.616333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:44.616606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:44.617247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:44.618696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d0ac2-5b0e-4deb-9385-c02a910031bb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:44.706633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:40:44 2022] POST /identity/v3/users => generated 275 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:48.135002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea892-69fd-4452-8cb6-0710f3c2d657 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.136062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea892-69fd-4452-8cb6-0710f3c2d657 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.136556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ea892-69fd-4452-8cb6-0710f3c2d657 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.138193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 31/62] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:48.143763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ff118-1164-42c3-bd28-e59759f33b9c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.144226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ff118-1164-42c3-bd28-e59759f33b9c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.144393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ff118-1164-42c3-bd28-e59759f33b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.168957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ba2ff118-1164-42c3-bd28-e59759f33b9c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:48.170507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba2ff118-1164-42c3-bd28-e59759f33b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:48.181628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7b2b-b485-445b-802e-778a4b82f08b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.181628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7b2b-b485-445b-802e-778a4b82f08b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.181628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d7b2b-b485-445b-802e-778a4b82f08b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.182045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 32/63] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:48.183286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17946-4744-44b3-947d-b31b6187ad6a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.183768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17946-4744-44b3-947d-b31b6187ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.184328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c17946-4744-44b3-947d-b31b6187ad6a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.185728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 33/64] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:48.191235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aeb0-53a2-450e-88da-748cba2085e3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.191525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aeb0-53a2-450e-88da-748cba2085e3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.191805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5aeb0-53a2-450e-88da-748cba2085e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.212181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9ec5aeb0-53a2-450e-88da-748cba2085e3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:48.220827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9ec5aeb0-53a2-450e-88da-748cba2085e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:48.220827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:48.250558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:48.252245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7e65-a2d2-4294-b5dd-7bc1892e94d5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.252683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7e65-a2d2-4294-b5dd-7bc1892e94d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.253104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b7e65-a2d2-4294-b5dd-7bc1892e94d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.271693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-328b7e65-a2d2-4294-b5dd-7bc1892e94d5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:48.273262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-328b7e65-a2d2-4294-b5dd-7bc1892e94d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:48.319952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 34/66] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:48.369358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:48.427382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52cc-a14e-499e-9f5f-f0f81108cc2f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.428724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52cc-a14e-499e-9f5f-f0f81108cc2f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.429198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c52cc-a14e-499e-9f5f-f0f81108cc2f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.431164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 35/68] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:48.436160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f389a7-a16a-44de-8276-ae345c6c3bca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.436460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f389a7-a16a-44de-8276-ae345c6c3bca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.436740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f389a7-a16a-44de-8276-ae345c6c3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.465462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d7f389a7-a16a-44de-8276-ae345c6c3bca None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:48.466683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d7f389a7-a16a-44de-8276-ae345c6c3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:48.496630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:48.544521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:48.608684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c52cc-a14e-499e-9f5f-f0f81108cc2f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:48.631002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c295b4-68cc-4884-90bb-b9717f72049f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.631588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c295b4-68cc-4884-90bb-b9717f72049f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.632097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c295b4-68cc-4884-90bb-b9717f72049f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.633909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 35/70] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:48.638510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.638993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.639449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.672897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:48.674360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:48.718739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c52cc-a14e-499e-9f5f-f0f81108cc2f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:48.760922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:48.761860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.762142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.762411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.765788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 36/71] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:48.766934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:48.771234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:48.774969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:48.780411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:48.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 36/72] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:40:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:48.787861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:48.866570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:48.878548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d22e7-f65b-4942-a02c-b0b71ad360a8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:48.887440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a261509-1cb4-41d9-af0b-fce5dfa0b7c8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:48.921178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:48.922059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.922239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:48.922368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.922608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.923115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:48.923397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:48.923671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:48.933058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:48.934335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:48.938018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:48.938821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:48.939579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:48.940228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:48.940964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:48.941692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:48.942262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:48.942326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:48.942326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.012588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.053894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c95a56-a6b0-4e56-a21d-b8189671e1a1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.062696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64a858-5bc6-4ec8-b0dc-2464443e3584 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.091027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.091638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.091943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.092220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.092883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:49.093184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.094582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.098381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.099007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.099291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.099600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.102631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:40:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.103228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.109697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:49.114952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:49.116010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:49.116773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 38/76] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:49.117631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.121018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.207043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5448d75-b3c6-4ea2-a7d6-c6f791907ce6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.213870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e354739-51c5-48e2-af40-10b2d40cbd33 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.234071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.239879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.240621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.240906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.241180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.241897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:49.242173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.243537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.248058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.248690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.248967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.249238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.249894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:49.250200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.251370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 39/77] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.251564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.252179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.267382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 39/78] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.268146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.326764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.355788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79624fb-15bf-43a4-a354-624df79616cc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.364599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97439bd-cbd8-4ef4-9071-e0e1bbbaa0b0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.387844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.388523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.388784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.389063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.390163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.391594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.393176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 40/79] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.393936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.398823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.399472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.399761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.400086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.415059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.416549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.418161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 40/80] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.418922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.465809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.501325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854db-42ed-4886-b157-51fc8b24f42e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.521076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9fdcc-b623-4eb0-b98c-a965194243c0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.534350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.534962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.535244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.535517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.536210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:49.536511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.537914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.545941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 41/81] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.546717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.549158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.557325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.560293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.560293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.560293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.560293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.561135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.562707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.563446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.645565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248df5d-2c4b-40d1-9fb8-cd5c17c404ff None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.661176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee970e06-8eb3-46a1-ae3f-aa1146a108de None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.670325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.678169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.680363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.680363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.680363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.680572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.681908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.683471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 42/83] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.685355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.696303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.697291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.697850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.698294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.698969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.700642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.752424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.779736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 42/84] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:40:49 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:49.780554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.782832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbaead-4bc3-4317-a2e7-f2669822d237 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.823536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.824196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.824487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.824764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.899026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.900572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.900800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29442a1c-2c79-439f-9c97-dea0781f18ef None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:49.942376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:49.943051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:49.943382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:49.943663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:49.944908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:49.946401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:49.948245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 43/85] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:49.948846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:49.983547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:49.985711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.017687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:40:50.022466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.062842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e74b81-caba-43aa-be7d-9181e1dd130c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.105144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.105769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.106053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.106851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.140555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e49c1a-95ab-4a62-af58-d834fb9d22a7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.184059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.185020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.185617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.186140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.197430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.199299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.231743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.239865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.262511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.264019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.371203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 44/87] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:40:50.372721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.388005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:40:50.389265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.488357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.514291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f841-68f1-4043-adae-3445b9dc87a1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.527734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9854b-8954-413b-9281-c2d9c5f81197 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.549545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.555197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.555979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.556278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.556558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.571819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.573099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.573601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.574253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.576249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.578341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.580341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 45/89] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:50.586195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.640156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.642014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.701506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ee41a-74f1-4917-ae71-283831d98fec None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.739300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.739983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.740340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.740608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.741968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.743552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.749924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:50.749924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.755385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.763223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 45/91] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:40:50.765194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.798665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:50.860989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6644c-2ae5-46cf-8cda-22ccc8bd7f63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.883542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9c2f0-7451-4b5d-a1a2-8b8add06a862 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:50.901266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.901972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.902389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.902760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.904146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.905668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.907589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 47/92] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:50.913103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:50.925033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:50.925884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:50.926612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:50.927184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:50.928717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:50.929189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:50.930895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:50.943772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:50.943772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:51.037235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:51.089159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3c2a-e778-43dc-b6ce-2af300264ba1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:51.140569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:51.157396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cd7ad-6d0b-47f8-95e7-75c957a4a1ad None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:51.160696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:51.161575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:51.162163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:51.162642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:51.163611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:51.164206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:51.166124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:51.172860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:51.173891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:51.209533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:51.210200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:51.210495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:51.214432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] PATH_INFO: `/v3/projects/2ceea6c48ae0426090c590d1920c9fb0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:51.214432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceea6c48ae0426090c590d1920c9fb0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:51.214432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:51.221232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 47/95] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:50 2022] GET /identity/v3/projects/2ceea6c48ae0426090c590d1920c9fb0 => generated 312 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:51.230232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:51.313512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe07bb-7eca-4bfa-ab69-4e324467e1dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:51.362660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:51.363686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:51.364247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:51.364718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:51.366279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=858f2104639a431f8850986398647589) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:51.368889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:51.370630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5bed8-b2f9-487a-9572-17ae591cfe36 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:51.390061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:40:51 2022] GET /identity/v3/role_assignments?user.id=858f2104639a431f8850986398647589&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:51.419059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe22bc9-bb11-42cd-869b-b8ce2d4f4f51 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:51.484138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:51.485236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:51.485714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:51.486206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:51.487160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=2ceea6c48ae0426090c590d1920c9fb0, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:51.487664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:51.489472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c8a903-a195-4a99-8e5d-a099c23fff41 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:51.499560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:40:51 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=2ceea6c48ae0426090c590d1920c9fb0&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:52.471755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c3fd-22dc-45b6-b219-17030da48a84 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:52.472810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c3fd-22dc-45b6-b219-17030da48a84 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:52.473286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532c3fd-22dc-45b6-b219-17030da48a84 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:52.474946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:52.481326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc26c2-8131-476a-927c-99aac4bd6fe3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:52.481874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc26c2-8131-476a-927c-99aac4bd6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:52.481874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc26c2-8131-476a-927c-99aac4bd6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:52.513908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b8cc26c2-8131-476a-927c-99aac4bd6fe3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:52.515124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8cc26c2-8131-476a-927c-99aac4bd6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:52.554114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:52.610335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:52.799611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee97b2-ade6-4d06-bc9d-e01ced69bb85 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:52.800299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee97b2-ade6-4d06-bc9d-e01ced69bb85 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:52.800785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee97b2-ade6-4d06-bc9d-e01ced69bb85 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:52.802392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 51/100] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:52.807571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:52.807862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:52.808163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:52.836887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:52.838097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:52.918211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:53.089868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee97b2-ade6-4d06-bc9d-e01ced69bb85 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:53.092673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:53.213614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee97b2-ade6-4d06-bc9d-e01ced69bb85 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:53.259789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:53.260829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:53.261304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:53.261768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:53.263103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:53.264775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:53.266564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 52/102] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:53.272472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:53.368496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:53.425890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:53.479855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b51262-0ec6-4375-adc5-b0e0fdace1dd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:53.480689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:53.526048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263aa17-8448-4efa-9993-b282b3b704f0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:53.567700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:53.568429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:53.568714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:53.568993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:53.575028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:53.575646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:53.575943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:53.576223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:53.576872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:53.578322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:53.591543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:53.596935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:53.597763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:40:53.598495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:53.606903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 53/103] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:53.607816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:53.696702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 51/104] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:40:53 2022] POST /identity/v3/projects => generated 302 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:53.730464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13cac5-41dc-4621-bd24-773758154f2f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:53.761485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:53.771707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:53.772850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:53.773170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:53.773443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:53.774126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:53.774433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:53.775855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:53.789187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 54/105] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:53.795547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:53.922047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083a3c9-995e-4f4d-bc0c-78342a5b6717 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:53.964414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:53.964995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:53.965282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:53.965562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] PATH_INFO: `/v3/users/614323d6f9a74a1c979d39704bdee47b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:53.983152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:53.986859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=614323d6f9a74a1c979d39704bdee47b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:53.988489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966126d1-a92d-46aa-818e-b4dc87719fd6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:53.990620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 52/106] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:53 2022] GET /identity/v3/users/614323d6f9a74a1c979d39704bdee47b => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:53.996011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:54.136527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91bffc-513d-4cc0-b2aa-b5f624a70b2f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:54.179066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:54.179696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.179998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.180280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.247764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0966cb-b483-445c-9997-67dcb9353bff None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.248183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0966cb-b483-445c-9997-67dcb9353bff None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.252385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0966cb-b483-445c-9997-67dcb9353bff None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.252385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 53/107] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:54.253246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:54.263715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:54.265277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:54.265417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04638f3-a873-4454-b3fd-60463cb37c5b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.265701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04638f3-a873-4454-b3fd-60463cb37c5b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.265985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04638f3-a873-4454-b3fd-60463cb37c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.293565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a04638f3-a873-4454-b3fd-60463cb37c5b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:54.299571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a04638f3-a873-4454-b3fd-60463cb37c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:54.449482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 54/108] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:54.450678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f717d-8e5c-4e43-9aea-9393b260355f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.450975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f717d-8e5c-4e43-9aea-9393b260355f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.451320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f717d-8e5c-4e43-9aea-9393b260355f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.452593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 55/109] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:54.475367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f01f-1bb3-421a-99bc-3260e8ea1421 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.475659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f01f-1bb3-421a-99bc-3260e8ea1421 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.475960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0763f01f-1bb3-421a-99bc-3260e8ea1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.511050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 55/110] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:40:54.512429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0763f01f-1bb3-421a-99bc-3260e8ea1421 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:54.513684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0763f01f-1bb3-421a-99bc-3260e8ea1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:54.516790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:54.622820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 56/111] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:54.624678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d83f-10ab-424c-be77-459915958da4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.625110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d83f-10ab-424c-be77-459915958da4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.625554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23d83f-10ab-424c-be77-459915958da4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.626938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 57/112] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:54.636237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621223d3-bdd7-48c6-8b54-f373e491a413 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.636805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621223d3-bdd7-48c6-8b54-f373e491a413 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.637258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621223d3-bdd7-48c6-8b54-f373e491a413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.668445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-621223d3-bdd7-48c6-8b54-f373e491a413 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:54.675684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-621223d3-bdd7-48c6-8b54-f373e491a413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:54.717009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:54.734445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78ce8b-5650-41c9-8b35-2f0189b90b11 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:54.751558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:54.777354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:54.780536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd059-1a90-46d3-a5f4-6cf4016d2996 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.781002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd059-1a90-46d3-a5f4-6cf4016d2996 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.781443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fd059-1a90-46d3-a5f4-6cf4016d2996 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.783077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 59/114] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:54.789498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.790344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.790783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.806551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:54.807279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:54.807568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:54.807863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:54.811262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:54.812621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:54.812803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:54.814126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:54.815814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 56/115] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:54 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:54.822592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:54.893354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 60/116] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:40:54.974749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7c35c-6640-4e22-8173-5734016ad419 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.019218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.020266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.021079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.021541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.021957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.022826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=614323d6f9a74a1c979d39704bdee47b) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:55.023293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.024933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.031189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 57/117] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:40:54 2022] GET /identity/v3/role_assignments?user.id=614323d6f9a74a1c979d39704bdee47b&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:55.145244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200dca1-21a4-4224-8fb8-5526494dc3b8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.170353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.177012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.183169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.183847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.184166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.184437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.197462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:55.203146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:55.204258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:55.205228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:55.208183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 61/118] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:40:55.216287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.257805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bcc8a-1796-41ed-aa2b-05d740a7da9d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.346935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee08d2-0102-403a-a9d8-28a1cb384ce3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.371064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.371689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.372003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.372284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.373423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:55.373539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.374905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.389877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 62/119] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:55.389877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.392927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.393745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.394169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.394586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.405712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:55.410669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:55.411499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:55.412834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 58/120] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:55.413453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.444061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.511493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.527245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336c4ad-544e-4e0d-b8e0-2a1d4d1458ab None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.528647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a834c-47a2-4f40-a048-999ad5deebfc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.566236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.567148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.567575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.568052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.572101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.572823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.573180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.573528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.580413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:55.586304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:55.587155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:40:55.587899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:55.588526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:55.590278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 59/121] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:55.594058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:55.594910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 63/122] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:55.595674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.599986 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.718612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675a18b-a21f-4dc1-b309-2b951814e6b6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.726699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.731764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e032-c203-407f-be21-7e1ff1bd37eb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.756258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.757026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.757601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.757986 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.759359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:55.759772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.761407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.770783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 60/123] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:55.772128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.777106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.777929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.778358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.778779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.780124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.781717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.783307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:55.785048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:55.790903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.887638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d3d5-e817-4ade-b5c2-93c6354d693e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.910640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e6a66-4f24-4e02-a9d1-42797aea7cb7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:55.926127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.927085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.927624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.928180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.929115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:55.929637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.931317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.940372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:55.941509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:55.949573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:55.950193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:55.950479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:55.950758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:55.951433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:55.951740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:55.953286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:55.963110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:55.968414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.001750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.017812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.055075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479c45e-fec7-42aa-9e35-40b63e930267 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.086063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cc433-6153-4c70-9296-9ac363639df2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.098360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.099521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.099820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.100130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.101691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.103480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.106135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.106835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.128534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.129649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.130084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.131012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.132359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.134023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.135823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 66/128] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:55 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.136835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.222416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90747fd-e56d-4f18-9763-56986152df1f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.258291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.260562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.261452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.261938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.262040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2fab-df5e-4c73-a712-20369732acf6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.262524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.263958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.265705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.267519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 63/129] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:56 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.268529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.273130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.300743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.301696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.302216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.302949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.304925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.306839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.308642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 67/130] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:56 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.309586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.385613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29691598-c7c5-44a2-bbb5-dd9ee2d9dbaf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.427044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.427818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.428266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.428666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.430215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.431964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.433871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:56 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.434691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d5e3e-ecc1-49e4-8bb7-472b5fae7b7e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.434926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.479946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.480613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.480899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.481182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/858f2104639a431f8850986398647589/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.484366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, user_id=858f2104639a431f8850986398647589, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.485842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.522120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.552762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6fe21-440a-4603-b182-b4e6c1ec80cd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.585891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.586571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.586860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.587141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.588314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.589785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.591455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:56 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.592245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.603991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 68/133] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:40:56 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/858f2104639a431f8850986398647589/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:56.604801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.642423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.724293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9ea14-c32a-4775-b0b7-9beb37e4249a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.733698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73505a2e-5f71-4b1d-a8de-c71025701e0f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:56.764430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.765152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.765413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.765698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/2618505b7e7946dcb41e3023407b7251/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.767828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, user_id=2618505b7e7946dcb41e3023407b7251, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.769375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.781910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:56.783004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.783445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.790700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] PATH_INFO: `/v3/projects/2ceea6c48ae0426090c590d1920c9fb0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.790700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceea6c48ae0426090c590d1920c9fb0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:56.790700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3382-2c21-4b46-9447-7172e20b8127 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:56.790700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 66/134] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:56 2022] GET /identity/v3/projects/2ceea6c48ae0426090c590d1920c9fb0 => generated 312 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:56.790700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b036d-eb9c-432f-b3e6-ca22e47a30f3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:56.791073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b036d-eb9c-432f-b3e6-ca22e47a30f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:56.791219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b036d-eb9c-432f-b3e6-ca22e47a30f3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:56.792663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 67/135] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:56.793449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b036d-eb9c-432f-b3e6-ca22e47a30f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.806302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:56.890634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:40:56 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/2618505b7e7946dcb41e3023407b7251/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:56.896127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:56.920983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b036d-eb9c-432f-b3e6-ca22e47a30f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:57.001447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:57.002001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.002344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.002634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/2618505b7e7946dcb41e3023407b7251/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.007828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, user_id=2618505b7e7946dcb41e3023407b7251, role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:57.014436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a9c10-c02e-43cd-a409-60c646053026 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:57.032636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:57.051170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03f400-077c-4df3-aaba-2a101163fde9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:57.091558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:57.092595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.093055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.093505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] PATH_INFO: `/v3/projects/2ceea6c48ae0426090c590d1920c9fb0/users/2618505b7e7946dcb41e3023407b7251/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.103226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:40:56 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/2618505b7e7946dcb41e3023407b7251/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:57.104805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc52f8a-47e4-4855-8458-b225a72d5063 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.105249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc52f8a-47e4-4855-8458-b225a72d5063 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.105809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc52f8a-47e4-4855-8458-b225a72d5063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.110541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] RBAC: Authorizing `identity:create_grant(project_id=2ceea6c48ae0426090c590d1920c9fb0, user_id=2618505b7e7946dcb41e3023407b7251, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:57.113713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d274d8-69e2-47e0-bbbf-b5c1ce41b187 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:57.137251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7bc52f8a-47e4-4855-8458-b225a72d5063 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:57.138877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7bc52f8a-47e4-4855-8458-b225a72d5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:57.202749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:40:56 2022] PUT /identity/v3/projects/2ceea6c48ae0426090c590d1920c9fb0/users/2618505b7e7946dcb41e3023407b7251/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:57.243314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:57.250199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 69/139] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:57.525706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f8e5-00d7-4d81-8935-1a31ab3508b0 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.526339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f8e5-00d7-4d81-8935-1a31ab3508b0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.526842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f8e5-00d7-4d81-8935-1a31ab3508b0 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.528439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 71/140] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:57.534880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.535812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.536319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.560580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:57.562132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:57.638641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f8e5-00d7-4d81-8935-1a31ab3508b0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:57.647544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:57.777189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f8e5-00d7-4d81-8935-1a31ab3508b0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:57.822447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:57.823086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.823407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.823687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.824873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:57.826376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:57.828200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 72/142] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:40:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:40:57.833859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:57.946437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bef444-1e07-4aa2-8e30-4cc478b66cec None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:57.974324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:57.984980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:57.986087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:57.986464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:57.986930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:57.987676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:57.989265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:58.129173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 71/143] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:40:57 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:40:58.149760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:58.169142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:58.290501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bae68-3104-4a4c-b295-e79dfc8b61ca None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:58.339302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:58.339965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:58.340258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:58.340535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:58.352343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:58.357753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:58.358598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:40:58.359338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:58.367906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:58.489571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157664-f1be-46ae-968e-6f08193123aa None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:58.531399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:58.532045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:58.532325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:58.532607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:58.533270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:40:58.533572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:58.534949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:58.545117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:40:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:58.550673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:58.649337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:58.688440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d5acf-a4ee-40c2-b503-e88419a14ee8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:58.731376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:58.732067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:58.732421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:58.732705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] PATH_INFO: `/v3/users/614323d6f9a74a1c979d39704bdee47b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:58.733862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] RBAC: Authorizing `identity:get_user(user_id=614323d6f9a74a1c979d39704bdee47b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:58.735304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:58.736988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 74/146] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:40:58 2022] GET /identity/v3/users/614323d6f9a74a1c979d39704bdee47b => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:58.742767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:58.814004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:58.875865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29cfc4-5a87-48a2-9113-82b5a9e3f59d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:58.919405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:58.920099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:58.920380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:58.920651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:58.922393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:58.923846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6af17f-f5ec-49f4-ba43-41d63121cb42 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:58.925515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 73/147] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:40:58 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:40:58.933159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:59.051801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8612d-59b8-4845-b20f-1be5fb569904 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:59.089561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:59.090233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:59.090514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:59.090797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/614323d6f9a74a1c979d39704bdee47b/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:59.092772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, user_id=614323d6f9a74a1c979d39704bdee47b, role_id=5dabfef5ca6a4ecbb6b855e06c2f3c8b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:40:59.094227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ed8da-aa6a-42e6-b1a4-931235d02a20 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:40:59.199442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 75/148] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:40:58 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/users/614323d6f9a74a1c979d39704bdee47b/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:40:59.347340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e755-bcb9-4466-89b7-ef525d9dae70 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:59.347628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e755-bcb9-4466-89b7-ef525d9dae70 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:59.347815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964e755-bcb9-4466-89b7-ef525d9dae70 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:59.349394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 74/149] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:40:59.355219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:59.355566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:59.355767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:59.363500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:59.382113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:40:59.383360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:40:59.483620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 76/150] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:40:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:40:59.782444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e755-bcb9-4466-89b7-ef525d9dae70 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:40:59.905231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964e755-bcb9-4466-89b7-ef525d9dae70 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:40:59.924899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:40:59.950170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:40:59.955237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:40:59.955237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:40:59.955237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:40:59.965631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:40:59.970789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:40:59.971803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:40:59.972607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 75/151] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:40:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:40:59.981086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:00.125969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3436f2-d9f4-448f-988f-c0c3bfb120ad None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:00.161404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:00.167119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:00.167745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:00.168067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:00.172313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:00.173079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:00.173396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:00.174805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:00.184112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:40:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:00.190032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:00.345263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eff8fb-4433-493e-b423-4a91e3beb8dc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:00.403361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110780de-da2e-487b-93df-86623b809f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:00.404359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110780de-da2e-487b-93df-86623b809f01 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:00.404856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110780de-da2e-487b-93df-86623b809f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:00.405316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110780de-da2e-487b-93df-86623b809f01 None admin] PATH_INFO: `/v3/users/858f2104639a431f8850986398647589` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:00.406704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110780de-da2e-487b-93df-86623b809f01 None admin] RBAC: Authorizing `identity:get_user(user_id=858f2104639a431f8850986398647589)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:00.408418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110780de-da2e-487b-93df-86623b809f01 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:00.410203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 76/153] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:00 2022] GET /identity/v3/users/858f2104639a431f8850986398647589 => generated 247 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:00.416181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:00.555872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03838d-fc26-43e3-b4b4-db0d592fee64 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:00.599544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:00.600197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:00.600482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:00.600764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:00.626599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9bc7-b2d2-4a87-a00c-91c8e956dc15 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:00.627198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9bc7-b2d2-4a87-a00c-91c8e956dc15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:00.627685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df9bc7-b2d2-4a87-a00c-91c8e956dc15 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:00.629239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 77/154] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:00.639672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:00.640233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:00.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:00.668535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:00.669663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:00.694144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:00.705773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:00.707656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:00.753809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:00.830122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 78/155] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:00.896962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 78/156] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:00.902405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:01.038542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469ef76-18e2-4f5d-b77f-b36492e1ffb1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:01.078983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:01.079635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.079940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.080220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.081368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:01.082861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dd3be-f985-46eb-baa9-a72e8518dcf8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:01.084889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 79/157] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:00 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:01.090759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:01.172941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44315b-f38e-4002-9665-26183a277c10 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.173613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44315b-f38e-4002-9665-26183a277c10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.174155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a44315b-f38e-4002-9665-26183a277c10 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.180025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 80/158] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:01.194233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.194845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.195320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.226196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:01.227784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:01.250959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:01.260491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f3eb1-8663-49de-aece-c457fb639491 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:01.316025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:01.330808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:01.331437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.331718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.332434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.333367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=858f2104639a431f8850986398647589) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:01.333835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:01.335294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9390a-1500-4881-88f5-45e59e4b216f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:01.346558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 79/159] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:01 2022] GET /identity/v3/role_assignments?user.id=858f2104639a431f8850986398647589&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:01.377243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 81/160] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:01.538430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30689-4a35-4313-97c7-b369500e4ad2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.538764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30689-4a35-4313-97c7-b369500e4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.538987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30689-4a35-4313-97c7-b369500e4ad2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.540757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 80/161] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:01.548939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:01.554431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.554719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.554993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.579068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:01.580228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:01.717417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:01.743019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a756a41-4dae-4d1c-b1f2-d2f1cb97621a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:01.795452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:01.796147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:01.796428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:01.796698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:01.812016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:01.816931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:01.818418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:01.819313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 82/163] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:01.825026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:01.945356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:01.957278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797156-ff38-44ba-be26-84e80d841df4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.001480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.002101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.002387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.003348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:02.003651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:02.005090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:02.019610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 82/164] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:02.025844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.047957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.081833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:02.176317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9704ad-c2a3-42df-8b8c-42d3ceff5d30 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.221472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c45c80-28a2-44fa-a06f-a5512c65d489 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.222003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.222003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.222003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.222003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.222787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:02.224414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:02.227513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:02.232895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.297027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.298023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.298491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.298976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.317362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:02.327844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:02.328733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:02.329797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:02.332028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 83/166] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:02.335360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.360418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:02.441580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:02.457884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df060ac3-db79-4ae5-9d65-3495afcc7e0e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.493909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f061c-3467-4c3f-bb1f-c156e89d9457 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.546156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.546812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.547098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.547376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.565210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.565846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.566134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.566414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.567870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:02.580777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:02.581696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:02.583118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.684247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:02.685751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:02.722447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:02.786010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d22e1d-2da1-4950-a61d-3afa1d4f92d7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:02.846207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:02.847191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:02.847612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:02.848073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:02.849026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:02.850001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:02.851543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:02.860565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:02.861595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:02.916017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:02.922860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 84/169] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:02.929475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.047319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f537bbe-6761-401f-b695-d6af97ff26bf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.079834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.090257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.090884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.098506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.098506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.098506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:03.098506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.098506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.113227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 86/170] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.114019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.155424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d34816-dd52-4f62-beaf-2b46970281dc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.233364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.234029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.234310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.234582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.237612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.239131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051b2e5-cbd4-4939-8e1f-16f639282a88 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.244300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 85/171] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:02 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.250164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d340c-7c52-42f0-aa04-130708d41955 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.250508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d340c-7c52-42f0-aa04-130708d41955 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.250807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d340c-7c52-42f0-aa04-130708d41955 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.252309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 86/172] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:03.252946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d340c-7c52-42f0-aa04-130708d41955 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.269370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85da23-fa22-4fdf-970e-b85bf8b0eff3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.322579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.323144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.323425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.323696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.325021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.326479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.328330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 87/173] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.334453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.385169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.405872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.421736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d340c-7c52-42f0-aa04-130708d41955 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.443680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0703-e195-4bd3-89cd-6635357939ec None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.454742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.455374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.455649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.455928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] PATH_INFO: `/v3/users/2618505b7e7946dcb41e3023407b7251` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.457044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] RBAC: Authorizing `identity:get_user(user_id=2618505b7e7946dcb41e3023407b7251)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.458533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9abb4-550c-4ee8-9985-9f2c173a2485 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.466187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 87/174] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/users/2618505b7e7946dcb41e3023407b7251 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.467528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.467816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.468123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.480903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.481522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.481805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.482081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.485496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:03.486685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:03.547521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.549012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b9bb0-4599-42d7-a43e-05edaf5e7e37 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.551998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 88/175] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:03.552862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.613085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.620116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.655696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 88/176] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:03.656101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164aae82-6d19-4dc1-b3b5-dafb55aaf8f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.656982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cefc2-f783-4135-b344-5bc967dda34e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.657272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cefc2-f783-4135-b344-5bc967dda34e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.657557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cefc2-f783-4135-b344-5bc967dda34e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.658810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 89/177] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:03.659839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8eb9-9051-48fb-a2a5-aa6fbb383cd9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.660172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8eb9-9051-48fb-a2a5-aa6fbb383cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.660671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af8eb9-9051-48fb-a2a5-aa6fbb383cd9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.662092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 90/178] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:03.662969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4664a-81cc-46b1-90f6-6c5e2b716675 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.663255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4664a-81cc-46b1-90f6-6c5e2b716675 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.663530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4664a-81cc-46b1-90f6-6c5e2b716675 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.668037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 91/179] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:03.668037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4664a-81cc-46b1-90f6-6c5e2b716675 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.702806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.703422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.703703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.704003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.704735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:03.705044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.706488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.712339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 89/180] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.721300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:03.791074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4664a-81cc-46b1-90f6-6c5e2b716675 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.837249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.837883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.838166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.838468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.844352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1848fa-cf86-44bd-8b8b-8f859d23671a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:03.878717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.881404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:03.890382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:03.891034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.894262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.894262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.894262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.894262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51bbf6-c8f3-4e83-afd6-2f7e7e7ea39a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:03.896090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 90/181] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:03.901306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef886-510b-406e-9e4d-33f09f2d3f88 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:03.901598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef886-510b-406e-9e4d-33f09f2d3f88 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:03.901874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef886-510b-406e-9e4d-33f09f2d3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:03.921447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc4ef886-510b-406e-9e4d-33f09f2d3f88 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:03.922046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:03.922631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc4ef886-510b-406e-9e4d-33f09f2d3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:03.924330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e53f5-3151-4036-9e09-615ffaea1764 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.000388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:04.001784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.002133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.002415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.026396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:04.027584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:04.039082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 92/183] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:04.039082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.039082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.039082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.055800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:04.057026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:04.103253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 92/184] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:04.104964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.126614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.129496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:04.131702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.208791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.294225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c0ff-d318-4cfe-8caa-d8cef5339015 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.299825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939100f-6d27-4823-a60d-bc3ab8cc981b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.338103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.338536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.339147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.339336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.339742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.339852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.340270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.340389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.341191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:04.341645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:04.343469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.350882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 94/186] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:04.355950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.359113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:04.367179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:04.376390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:04.377199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:04.379711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:04.380855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.424661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.482941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2742c49-d5d1-4dd1-b488-1403e00127b2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.507209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1b647-bf4c-4bfb-8aed-04bdc0045b32 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.525687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.526070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.527058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.527527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.527632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] PATH_INFO: `/v3/projects/2ceea6c48ae0426090c590d1920c9fb0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.528847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=2ceea6c48ae0426090c590d1920c9fb0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:04.530685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.537730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/projects/2ceea6c48ae0426090c590d1920c9fb0 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:04.537730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.550252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.550887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.551167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.551439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.552631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:04.554491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.555655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 94/189] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:04.556438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.653339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1329033-ac00-4902-8b0c-86626dd96ea7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.669092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0190188-53e8-42c0-9f6a-c55c5485ecd9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.676621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.686834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.687441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.687716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.688017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.688674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:04.688979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:04.690344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.698544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 96/190] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:04.699320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.706783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.707422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.707732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.708046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.718967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:04.723860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:04.725326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:04.726088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 95/191] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:04.726738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.772064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.800836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a46d4f-c85a-4862-b9b5-e25beaf1f727 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.827358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865fcd81-8292-46a4-a57b-2c7935125396 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.834502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.835133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.835414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.835684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.846151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:04.851018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:04.852077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:04.853046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.865778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:04.866394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:04.866678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:04.866951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:04.867690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=2ceea6c48ae0426090c590d1920c9fb0, user.id=2618505b7e7946dcb41e3023407b7251) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:04.868029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:04.869516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:04.875157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/role_assignments?user.id=2618505b7e7946dcb41e3023407b7251&scope.project.id=2ceea6c48ae0426090c590d1920c9fb0&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:04.875975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:04.906134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:04.968994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a0fb-0287-4cad-b115-91c590e18ce4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:04.993792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042c03e-ea5a-47df-920b-80658c451dce None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.003987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.009472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.010132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.010380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.010655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.011325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.012833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.031543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.032323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.032671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.033008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.048761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.050273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.051968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 97/194] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:04 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.052814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.123292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 98/195] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:04 2022] POST /identity/v3/users => generated 297 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:05.133000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.166004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93663edf-7b89-4508-8866-33a7e6545372 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.204775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.205717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.206171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.206608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.207467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:05.208092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.213250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.219449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 98/196] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.224297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.257537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.266937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ed9c1-cbf7-44e1-b94d-a927ba7ae15b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.268908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.307960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.307960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.308672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.308672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.309164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:05.309797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.310891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.321998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.322933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.342901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975c862-84d3-4585-97c8-97e4486085ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.384693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.385639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.385639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.385914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.454237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20d04-1da9-4ec8-a8b1-2ad36af094f9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.481317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.483279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.498949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.499600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.499886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.500307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.503059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.503831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.506708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 100/198] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.507018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.528284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.539470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.598507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:05.600411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.613012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6022-acdf-4b7d-a290-d119017df345 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.648686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.649349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.649620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.649902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] PATH_INFO: `/v3/users/614323d6f9a74a1c979d39704bdee47b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.651263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] RBAC: Authorizing `identity:get_user(user_id=614323d6f9a74a1c979d39704bdee47b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.652726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.654622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 101/200] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/users/614323d6f9a74a1c979d39704bdee47b => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.655516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.719363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947c8b-e059-4d52-ba89-190145150c41 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.747946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.756068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.756817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.764359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.764359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.772835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:05.777086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5addbf49-82da-4497-9c97-ccbf07262475 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.827977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.827977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.827977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.827977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.828459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.828459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.828459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 102/201] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:05.829089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:05.850160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:05.852005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:05.943095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac1f0-e2ec-4603-9cf0-084fae121d70 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:05.982349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:05.982972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:05.983252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:05.983524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:05.988994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 100/202] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:05.989908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:06.021729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:06.031117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:06.076162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.077960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.106242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f2e984-302e-4473-aa15-221b79b0de63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:06.151698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:06.152586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:06.153145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:06.153567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:06.154444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=41de62922c11416e9eaf54e7b8566def) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:06.154920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.157121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.166210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 101/203] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/role_assignments?user.id=41de62922c11416e9eaf54e7b8566def&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:06.167335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:06.227833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:06.233898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:06.288722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:06.300648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1db731-e17b-403c-bb59-d685e7edc9c2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:06.344442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:06.345386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:06.346022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:06.346449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:06.348452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.350167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.352145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 102/205] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:06 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:06.358404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:06.400867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:06.449496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac122c-c83a-4b72-95bf-bfc40f5d2ce2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:06.493964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:06.494824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:06.495303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:06.495757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:06.497977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.499585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.501647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 104/206] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:06 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:06.513767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:06.544922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f54ad3-0842-44a4-82ae-d3c0a89b11cf None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:06.609962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:06.610583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:06.610862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:06.611139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:06.611868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=41de62922c11416e9eaf54e7b8566def) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:06.612207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.613658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be17797a-9013-4321-9516-688c449a31d9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.625761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:06 2022] GET /identity/v3/role_assignments?user.id=41de62922c11416e9eaf54e7b8566def&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:06.671903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908809e5-17b6-4eb4-8dd9-075100c890b2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:06.726695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:06.727328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:06.727611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:06.727887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:06.728671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e, user.id=614323d6f9a74a1c979d39704bdee47b) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:06.728981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:06.730459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f38ccf-9226-4a13-8335-f78312acc856 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:06.733841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:06.738577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:06 2022] GET /identity/v3/role_assignments?user.id=614323d6f9a74a1c979d39704bdee47b&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:07.516255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19749-f0cf-4bd2-b03a-499e0f1dbaf5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:07.516786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19749-f0cf-4bd2-b03a-499e0f1dbaf5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:07.516786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19749-f0cf-4bd2-b03a-499e0f1dbaf5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:07.518151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 104/209] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:07.524200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82f00-3a5e-43f6-a863-00b4f1fac0b0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:07.524601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82f00-3a5e-43f6-a863-00b4f1fac0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:07.524760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e82f00-3a5e-43f6-a863-00b4f1fac0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:07.544847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-48e82f00-3a5e-43f6-a863-00b4f1fac0b0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:07.546166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-48e82f00-3a5e-43f6-a863-00b4f1fac0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:07.619581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:07.665889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84806-3a72-46dd-80c8-8db39c722a79 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:07.666175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84806-3a72-46dd-80c8-8db39c722a79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:07.666454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84806-3a72-46dd-80c8-8db39c722a79 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:07.667877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 105/211] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:07.673398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:07.673687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:07.673962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:07.693582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:07.694801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:07.767019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:07.899936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84806-3a72-46dd-80c8-8db39c722a79 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:07.926142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.005789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84806-3a72-46dd-80c8-8db39c722a79 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.041557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.042115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.042399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.042674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.052436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.053561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:08.058940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:08.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:08.060598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 106/213] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:08.071233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.119206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.161337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1368a-78fa-4327-82ea-cfc01dd3a414 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.169558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.192513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2646ef1-952e-4d16-a50a-d8983fe2c018 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.200577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.201392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.201736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.202017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.203208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.204705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.206456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:08.212144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.233410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.234130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.234416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.234690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.235361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:08.235666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.237370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.247123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:08.253466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.332794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b8425-7951-4ebe-b907-b5bd7765675b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.362965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.365957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0aa755-cecb-459a-a527-2ae007d13c81 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.371445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.372190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.372531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.372868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.374096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.375442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a2c57-e966-4176-ab46-730c62eb4c13 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.403462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.404261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.404615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.404954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] PATH_INFO: `/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.419963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] RBAC: Authorizing `identity:get_user(user_id=7ba921ea9c574aaf9abcd4f26aa7f9b0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.421561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.423435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 108/216] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:08.429324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.432764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.501092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 109/217] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:08 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:08.553626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10123e-8cd9-48a6-978a-65d6061c6bed None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.597731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f892-5559-4416-b493-85b091005833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.598296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f892-5559-4416-b493-85b091005833 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.598578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f892-5559-4416-b493-85b091005833 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.598854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f892-5559-4416-b493-85b091005833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.679661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f892-5559-4416-b493-85b091005833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.681551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f892-5559-4416-b493-85b091005833 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.684867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.691676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee106a-82cb-4197-a3ea-d2d722b650ad None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.692338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee106a-82cb-4197-a3ea-d2d722b650ad None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.692338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee106a-82cb-4197-a3ea-d2d722b650ad None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.693694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 110/218] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:08.699724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.700059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.702465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.724904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:08.726114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:08.815628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:08.818578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:08.821838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f892-5559-4416-b493-85b091005833 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:08.930309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f892-5559-4416-b493-85b091005833 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:08.932689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:08.965829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:08.966514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:08.966748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:08.967021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:08.968204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:08.969678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea1372-76b8-493c-9ab3-dad1afac6adb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:08.971636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 110/221] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:08.978722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.000281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d067-aef4-482c-9219-d8c61f365858 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.001129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d067-aef4-482c-9219-d8c61f365858 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.001556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d2d067-aef4-482c-9219-d8c61f365858 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.003375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 111/222] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:09.008938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.009405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.010132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.033746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:09.035058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:09.115222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be97d-f076-4292-a6c8-5054d9877583 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.128619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:09.130037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.137499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:09.204750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.205294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.205571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.205839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.206575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=7ba921ea9c574aaf9abcd4f26aa7f9b0) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:09.206883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:09.208863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:09.222008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:08 2022] GET /identity/v3/role_assignments?user.id=7ba921ea9c574aaf9abcd4f26aa7f9b0&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:09.249114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7255-f372-4d09-8b6c-d9f206156728 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.251145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:09.289015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.290307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.290817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.291332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.303394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:09.309597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:09.310463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:09.311274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:09.313706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:09.320288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.462087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922a487-2ddd-47f1-bc15-1f0916264ec9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.499715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.500379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.500664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.500938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.501608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:09.501916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:09.503301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:09.513542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:09.519105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.521827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.578110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:09.629378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5bd37-954b-460a-a2ca-5dba42f3895b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.655122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b7d05-56ce-43de-91a4-22705590e60d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.670453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.671445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.672022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.672516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.673990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:09.675777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:09.678548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 114/227] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:09.685756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.708630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.709287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.709585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.709848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.722191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:09.728196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:09.742625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:09.743555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:09.744376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 114/228] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:09.753674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.808110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6a281-b192-4d6e-879e-ca17b5720d91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.846161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.847167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.847669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.848192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.849571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:09.851258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:09.853511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 115/229] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:09.860899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:09.910373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:09.915942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39849a05-b724-43a0-9c75-8f0c96a7eb8e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:09.955590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:09.956295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:09.956577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:09.956849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:09.957893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:09.958209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:09.959660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:09.968788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 115/230] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:09.974202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:10.070895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:10.076578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaab4e8-a1a8-4481-9fe0-590e1a4678ee None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:10.085765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825f14f-687e-4818-ba8f-d527df4127f5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:10.121261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:10.121909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:10.122190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:10.122462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:10.123715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:10.125196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:10.127128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 116/231] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:09 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:10.133317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:10.154950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:10.155706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:10.156010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:10.156290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/41de62922c11416e9eaf54e7b8566def/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:10.162435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, user_id=41de62922c11416e9eaf54e7b8566def, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:10.165738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:10.185533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:10.251284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 116/232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:41:09 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/41de62922c11416e9eaf54e7b8566def/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:10.270848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f645418-a3ff-4f6d-aa8e-1284dbf3328b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:10.323768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:10.324459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:10.324747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:10.325028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:10.326178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:10.327751 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccf2e0-f152-4563-a6a9-72295defc88a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:10.329672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 117/233] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:10 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:10.335974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:10.476002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eed1e-c037-42e2-8ce0-047cd7f6b5fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:10.509085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:10.509675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:10.509955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:10.510230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/41de62922c11416e9eaf54e7b8566def/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:10.512447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, user_id=41de62922c11416e9eaf54e7b8566def, role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:10.514073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d7312-0f1e-4c10-be2c-194f2b8ae810 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:10.605103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:41:10 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/41de62922c11416e9eaf54e7b8566def/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:11.360440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6562813-c43c-4275-a806-d2c18838d3f8 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:11.360950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6562813-c43c-4275-a806-d2c18838d3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:11.361023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6562813-c43c-4275-a806-d2c18838d3f8 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:11.362476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:11.368452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:11.368865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:11.369030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:11.393442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:11.394652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:11.412008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:11.430201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738097-8ab1-4002-98dd-1efdef2d2ebc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:11.430484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738097-8ab1-4002-98dd-1efdef2d2ebc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:11.430757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38738097-8ab1-4002-98dd-1efdef2d2ebc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:11.432138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 119/236] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:11.444879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:11.445167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:11.445447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:11.485027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:11.486320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:11.491878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 118/237] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:11.590098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:11.777094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:11.909295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e70ad12-f19b-428e-8c18-e2db0ac07fa7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:11.916105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:11.966518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:11.982901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:11.987105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:11.987561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:11.988030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:11.989335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:11.992064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:11.994691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:12.001822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.022934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:12.072325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ccc76-15e8-4e33-bfcd-2baeaf74d146 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.109043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.109977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.110546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.110965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.113692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81818d76-1f6c-4fde-9bce-7a1a74187d7a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.121747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2b6012a2-329e-4148-b855-62d3af3666ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:12.127203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:12.128107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:12.128896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:12.131229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 121/240] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:12.137700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1558a9-30f3-4e9d-80f9-46a973fdec63 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.138240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1558a9-30f3-4e9d-80f9-46a973fdec63 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.138775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1558a9-30f3-4e9d-80f9-46a973fdec63 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.144633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 122/241] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:12.145686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1558a9-30f3-4e9d-80f9-46a973fdec63 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.150822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.151639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.152107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.152526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.153325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:12.154917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e6a95-ba76-49e0-9826-4deb419c526a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:12.236498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 120/242] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:12 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:12.238169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.238593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.239059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.253538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:12.266594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:12.268792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:12.275080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1558a9-30f3-4e9d-80f9-46a973fdec63 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.357802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.358440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.358708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.359032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.359729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:12.360069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:12.360616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 121/243] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:12.361913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:12.372236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 123/244] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:12.381187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.396300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:12.530048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674383c-435c-4b46-8569-40b3b56841d1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.578722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.579364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.579639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.579909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] PATH_INFO: `/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.601357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] RBAC: Authorizing `identity:get_user(user_id=2d385ecbe8f54e7ca4c829ddea6b4ffe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:12.602886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:12.604578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 122/245] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:12 2022] GET /identity/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:12.610287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.668745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.724871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415a0e5-e813-4673-bc8e-1eba1d93a4cc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.735494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:12.768033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.769101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.769389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.769664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.782198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b491f0-8160-40c7-be0b-c2348c9e0958 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.792969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:12.825240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:12.826289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.826771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.827240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.840275 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-21c88c05-8878-428e-b4e3-ddcddb09e602 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:12.846815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:12.847738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:12.848555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:12.850045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:12.852436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 123/246] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:12.852639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bca70d-8c6d-468f-8b91-bc85a1f907d0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:12.857424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514af8-4884-44e5-8426-bc838e55b016 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.857674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514af8-4884-44e5-8426-bc838e55b016 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.860427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8514af8-4884-44e5-8426-bc838e55b016 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.860427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 124/247] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:12.860611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8514af8-4884-44e5-8426-bc838e55b016 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:12.970880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:12.972123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:12.972565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:12.972976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:12.986797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8514af8-4884-44e5-8426-bc838e55b016 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:12.994595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:12.996341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:13.009769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.031839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.032586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.032866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.033428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.034109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:13.034411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.037264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.052324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 125/249] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:13.053547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.068839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.090769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 125/250] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:13.091706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.196136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ec20-b14e-4829-8f66-6b522bc74cfb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.199596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37694671-d107-4fe0-920c-274e0a6ee890 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.236285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.236917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.237197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.237470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] PATH_INFO: `/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.238657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] RBAC: Authorizing `identity:get_user(user_id=7ba921ea9c574aaf9abcd4f26aa7f9b0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.240705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.241873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 126/251] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:13.247593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.248235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.249161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.249651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.250245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.251687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.257529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.259335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 126/252] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:13.265473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.400279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.416998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.467479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b019f-f37b-4721-be1d-248a48ad498c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.510533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3888f7-e941-426c-8fc3-6111adb75a63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.532074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.532718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.533004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.533279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.534406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.535906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.542516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 127/253] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:13.543526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.549216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.550117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.550581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.551020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.551910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=2d385ecbe8f54e7ca4c829ddea6b4ffe) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:13.553384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.555370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061a6b5-5738-46da-84fb-778a3b85b645 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.567655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 127/254] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/role_assignments?user.id=2d385ecbe8f54e7ca4c829ddea6b4ffe&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:13.567655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373633-df19-43c3-a5dd-6880eb6c4ae8 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.567655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373633-df19-43c3-a5dd-6880eb6c4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.567655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f373633-df19-43c3-a5dd-6880eb6c4ae8 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.574015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 128/255] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:13.577805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373633-df19-43c3-a5dd-6880eb6c4ae8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.714443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f3889c-67ef-4f63-8c20-bf754ec60bd4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.741183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.752749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.754778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.754778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.754778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.775378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fc7f52a6-b740-45a0-9f47-404bbbe6f740 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:13.786086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:13.787553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:13.788365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:13.792174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 128/256] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:13.793094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f373633-df19-43c3-a5dd-6880eb6c4ae8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:13.797792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.799309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.799791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.828653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:13.829880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:13.832468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:13.853281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:13.854480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:13.856126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:13.856616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/7ba921ea9c574aaf9abcd4f26aa7f9b0/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:13.858799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, user_id=7ba921ea9c574aaf9abcd4f26aa7f9b0, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:13.861279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:13.912895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 129/257] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:13.913901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:13.945447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 129/258] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:41:13 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/7ba921ea9c574aaf9abcd4f26aa7f9b0/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:14.038330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a75114-f1a3-4304-b97e-5639eb168a42 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.046590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:14.076266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.076907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.077233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.077512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.078202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:14.078509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:14.079962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:14.090069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 130/259] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:14.097093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.263203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458587df-f4eb-4a8b-aa26-2535b0214c89 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.280604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.302290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.303001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.303283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.303556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.304762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:14.306206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:14.307979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 130/260] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:14.313814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.376330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:14.408018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3dfc1-ff83-4ea2-b8ad-0a5dbafd4514 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.432240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7227-dec2-439c-ba16-a5fd8c2dc5d9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.467953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.469069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.469653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.470212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.484844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.485735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.486433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.487155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:14.489791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:14.497863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:14.498753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:14.499524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:14.504410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 131/261] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:14.510540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.568321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:14.617132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:14.619875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:14.697826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78841c86-3ac7-49dd-91a0-5f3e18fb3420 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.706800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:14.756057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.757062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.757558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.758026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.758890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:14.759406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:14.761593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:14.777600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 132/262] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:14.789208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.844639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 131/263] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:14.850816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:14.936485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:14.948799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12d1ac-4488-4403-acd4-426be3d85680 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:14.987739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:14.988425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:14.988854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:14.989188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] PATH_INFO: `/v3/users/41de62922c11416e9eaf54e7b8566def` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:14.991208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] RBAC: Authorizing `identity:get_user(user_id=41de62922c11416e9eaf54e7b8566def)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:14.993187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:14.995094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 133/264] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/users/41de62922c11416e9eaf54e7b8566def => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:15.000670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:15.035286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e587b4-db88-43a3-a7df-b4316ec9ecce None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:15.112330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:15.112892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.113168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.113437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.120372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:15.121869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:15.123786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 132/265] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:15.133041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:15.151217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:15.204752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4bdef-c733-4cc8-91af-a06bc0a8d473 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:15.267954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a33b-ce8f-4525-bcd8-3ecaf4b6ebc3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:15.280288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:15.280915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.281195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.281461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.305174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:15.305917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.306200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.306470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.307193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=41de62922c11416e9eaf54e7b8566def) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:15.307554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:15.309211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:15.316008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 133/266] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:15 2022] GET /identity/v3/role_assignments?user.id=41de62922c11416e9eaf54e7b8566def&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:15.344102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:15.414520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:15.416280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b1a00-5125-41cc-a2d5-f60e6daee197 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:15.572970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 134/267] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:15.578458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:15.639117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed812-0712-4959-b816-634f5c14de14 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.639446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed812-0712-4959-b816-634f5c14de14 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.639667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ed812-0712-4959-b816-634f5c14de14 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.641027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 135/268] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:15.657763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.658035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.658304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.673254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:15.682672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:15.684160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:15.727095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fed8c-75d1-4dc1-9be3-be16ae77137a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:15.748558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:15.765332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 136/269] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:15.793652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:15.794322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.794602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.794875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.796053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:15.797525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab6253f-039b-4d5e-a1b6-b4260735bc4f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:15.799452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 134/270] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:15 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:15.806082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:15.938033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26681aec-6228-4b4a-9c54-6a4e68dba483 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:15.940723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dec33-c5fd-4dad-b2d2-3364106b885a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.941009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dec33-c5fd-4dad-b2d2-3364106b885a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.941291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1dec33-c5fd-4dad-b2d2-3364106b885a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.943315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 135/271] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:15.949190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.949475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.949752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.983360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:15.983360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:15.983360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:15.983360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:15.984183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=41de62922c11416e9eaf54e7b8566def) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:15.984183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:15.984477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:15.984623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:15.984772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:15.993891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 137/272] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:15 2022] GET /identity/v3/role_assignments?user.id=41de62922c11416e9eaf54e7b8566def&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:16.097996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 136/273] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:16.151665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.214612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:16.264678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a849b0b-0b11-47a2-b891-270dd6c27429 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.300324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.301174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.301495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.301763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.312896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:16.317837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:16.319702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:16.320905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 138/274] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:16.325322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.432339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:16.452033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.487138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf2a1c-1d0e-4c87-854d-065e256aa536 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.530973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.532211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.533670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.534158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.535038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:16.535542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:16.537857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:16.554359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 137/275] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:16.555195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.571083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250eda-a25d-433d-88c8-a5cedca5d481 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.585943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:16.615107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.616145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.616569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.616984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.618301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:16.620249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:16.626721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 139/276] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:16.628052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.681536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d811c6-aac0-45cb-98cb-14756869bedb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.718656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.719589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.720162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.720609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] PATH_INFO: `/v3/users/85fe99afe73e4dd18858b40d34ba73cd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.722781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:16.737049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] RBAC: Authorizing `identity:get_user(user_id=85fe99afe73e4dd18858b40d34ba73cd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:16.738904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:16.745800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823bacf-a407-4494-ac65-12bc4c92e2ef None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.745958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 138/277] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:16 2022] GET /identity/v3/users/85fe99afe73e4dd18858b40d34ba73cd => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:16.746859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:16.784285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.785376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.785980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.787028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.787990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:16.790160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3236a0-c2e0-48aa-8f27-d7fd47d899f5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:16.865870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72223b-3a24-48d9-a06b-5932d7d235fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:16.898610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 140/278] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:16 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:16.907774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:16.908811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.909330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.909830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.910827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, user.id=85fe99afe73e4dd18858b40d34ba73cd, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:16.911450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:16.913298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2583fd6-be7e-4b1d-ae5a-03d9ad05fc09 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:16.920808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 139/279] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 13:41:16 2022] GET /identity/v3/role_assignments?user.id=85fe99afe73e4dd18858b40d34ba73cd&scope.system=all&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:16.939194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a631-2992-407f-9b2f-bf02f6808358 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.939555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a631-2992-407f-9b2f-bf02f6808358 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.939786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927a631-2992-407f-9b2f-bf02f6808358 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.941421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 141/280] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:16.948869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:16.949539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:16.950156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:16.972711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:16.974622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:17.042081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:17.051487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7382-50c2-4696-a99c-d1ad72d79413 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.051791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7382-50c2-4696-a99c-d1ad72d79413 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.053929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7382-50c2-4696-a99c-d1ad72d79413 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.053929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 142/281] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:17.061374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.061686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.061935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.062843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 140/282] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:17.088890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:17.090211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:17.122769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:17.167902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 143/283] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:17.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.436961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.491280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0a44a-3918-4001-b141-f605dd91646c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:17.551660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:17.553095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.553379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.553655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.577992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:17.580433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd6005-dff3-4b03-854a-08d823461cee None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:17.582997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:17.583872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:17.584686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:17.592375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 141/284] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:17.612962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.621525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:17.622160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.622437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.622709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.633853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:17.639387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:17.640309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:17.641090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:17.646326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.680283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:17.733393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:17.756467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f6b3-1902-41e6-ac93-0ebbf0e2525e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:17.793757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:17.794377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.794657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.794930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.795595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:17.795901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:17.799812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:17.821822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 145/286] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:17.825273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.840447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e26af-5dbd-4ffd-ada6-cc9cd1b531e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:17.908001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:17.908555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:17.908835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:17.909108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:17.910144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:17.910463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:17.912611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:17.926039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 142/287] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:17.941483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:17.994404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.018762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceff017-6c8a-4e62-b6af-d2697fd9e7c3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.064063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.064063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.064063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.064063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] PATH_INFO: `/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.064422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] RBAC: Authorizing `identity:get_user(user_id=7ba921ea9c574aaf9abcd4f26aa7f9b0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.064422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.064422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 146/288] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/users/7ba921ea9c574aaf9abcd4f26aa7f9b0 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:18.069788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:18.137867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244844-348f-4343-96a6-8ce07d450e29 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.158146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.200469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.201116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.201391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.201760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] PATH_INFO: `/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.203001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] RBAC: Authorizing `identity:get_user(user_id=2d385ecbe8f54e7ca4c829ddea6b4ffe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.204685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.206288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 143/289] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:17 2022] GET /identity/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe => generated 297 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:18.212169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:18.216158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f935f3-5374-48e6-b9e5-318e4dcec659 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.251659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.252310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.252592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.252866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.279949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.326792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.328510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.431892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 147/290] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:18.434633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5204-94e7-4649-bc02-b0fa105730f7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.437689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:18.512305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.540804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.541461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.541744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.542017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.543186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.544662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.546361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 144/291] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:18 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:18.555387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6632472-ce6f-43dc-b983-997846fdd0cf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.556802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:18.595965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.595965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.595965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.595965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.596679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.596679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.597892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 148/292] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:18 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:18.622255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:18.624288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.717519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a719bcc-a333-4571-ab85-ba2533262667 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.766441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.769085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.771107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.771596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/2d385ecbe8f54e7ca4c829ddea6b4ffe/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.774186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, user_id=2d385ecbe8f54e7ca4c829ddea6b4ffe, role_id=5dabfef5ca6a4ecbb6b855e06c2f3c8b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.775987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce96290-685d-4a14-8d9f-1b3c91cc3d73 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.795973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff9445-3970-41e1-ad4b-64aab48c8cc2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:18.822851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:18.835095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:18.836042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:18.836529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:18.837097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:18.838024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=7ba921ea9c574aaf9abcd4f26aa7f9b0) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:18.838669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:18.840391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d64ff4-2c8d-4afd-a78d-b047cc3d6af2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:18.847032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 149/293] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:18 2022] GET /identity/v3/role_assignments?user.id=7ba921ea9c574aaf9abcd4f26aa7f9b0&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:18.908365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 145/294] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:41:18 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/users/2d385ecbe8f54e7ca4c829ddea6b4ffe/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 13:41:19.418040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2db07f-7a98-40b2-9988-242a17d60bab None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.418372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2db07f-7a98-40b2-9988-242a17d60bab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.418723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2db07f-7a98-40b2-9988-242a17d60bab None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.420260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 150/295] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:19.425688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c753-27ed-4c50-9a75-1582695e419b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.426018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c753-27ed-4c50-9a75-1582695e419b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.426256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64c753-27ed-4c50-9a75-1582695e419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.448319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ad64c753-27ed-4c50-9a75-1582695e419b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:19.449582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ad64c753-27ed-4c50-9a75-1582695e419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:19.538073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 146/296] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:19.566553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d4934-cd65-4246-8542-762f566d84db None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.566835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d4934-cd65-4246-8542-762f566d84db None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.567118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d4934-cd65-4246-8542-762f566d84db None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.568515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 151/297] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:19.573719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.574015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.574353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.592752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:19.593933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:19.621044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:19.661876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 147/298] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:19.820689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8a48-5ccc-4f18-95a7-f329a34b79e4 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.821203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8a48-5ccc-4f18-95a7-f329a34b79e4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.821278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b8a48-5ccc-4f18-95a7-f329a34b79e4 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.822746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 152/299] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:19.825434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:19.827430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.827728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.828035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:19.848405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:19.849673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:19.935354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 153/300] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:19.947290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fee76c-fa6e-47cd-a68c-792f15ba82a6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:19.950970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:19.990993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:19.991635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:19.991936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:19.992216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.005694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:20.012183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:20.013284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:20.014084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 148/301] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:20.019014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.047761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.071769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b3cb2-86f9-4f76-99b4-eb84d9aa3369 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.093241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.116875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.117608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.117962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.118354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.128793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30eaef-cf8a-4a42-a34c-306849874636 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.132723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:20.137732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:20.138622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:20.139412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 154/302] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:20.145435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.175545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.176422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.177361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.177779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.178591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:20.179113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.180808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.190247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 149/303] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:20.196356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.266127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa632cca-a57c-4269-9426-cb49e19a4f81 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.291016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.304889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.305542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.305817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.306049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4f088-e4f0-49c0-82e5-d9cdd6206710 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.306166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.306742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:20.307047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.308444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.317006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 155/304] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:20.318597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.342239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.342804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.343083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.343355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] PATH_INFO: `/v3/users/85fe99afe73e4dd18858b40d34ba73cd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.344511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] RBAC: Authorizing `identity:get_user(user_id=85fe99afe73e4dd18858b40d34ba73cd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.345946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.347801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 150/305] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/users/85fe99afe73e4dd18858b40d34ba73cd => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:20.348591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.366605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.427600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aac901-8c25-421c-b0cc-bf963bd5730e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.449298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec3c3e-527a-49e1-a486-4aeabe0123e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.466750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.467411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.467681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.467992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.469155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.470597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.472217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 156/306] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:20.472967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.494639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.495279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.495562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.495837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] PATH_INFO: `/v3/users/6fb21312236747a7a6feaabacc184630` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.510384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] RBAC: Authorizing `identity:get_user(user_id=6fb21312236747a7a6feaabacc184630)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.511854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.518282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 151/307] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/users/6fb21312236747a7a6feaabacc184630 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:20.518282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.530077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.584407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb4fc8-7be2-4141-aa6f-25ad3d518340 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.594361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:20.616187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedd1c2-6f2b-4f7a-b751-ae9205fc1d2c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.621116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.621777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.622060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.622337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] PATH_INFO: `/v3/system/users/85fe99afe73e4dd18858b40d34ba73cd/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.623758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85fe99afe73e4dd18858b40d34ba73cd, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.625181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.650365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.650990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.651273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.651548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] PATH_INFO: `/v3/groups` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.652222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.653663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d2964-1ab6-4da8-875a-d507b4392558 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.711121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 157/308] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Sep 23 13:41:20 2022] PUT /identity/v3/system/users/85fe99afe73e4dd18858b40d34ba73cd/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:20.712029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:20.755950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 152/309] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Sep 23 13:41:20 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:20.846882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debf70b-e2d7-437c-8e4b-d54b753bddf6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:20.892017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:20.893005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:20.893522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:20.893798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:20.894548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, user.id=6fb21312236747a7a6feaabacc184630, scope.system=all) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:20.894858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:20.896351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9507b18a-82c7-4ca8-9575-ffd5b6fc66d2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:20.902219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 158/310] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 13:41:20 2022] GET /identity/v3/role_assignments?user.id=6fb21312236747a7a6feaabacc184630&scope.system=all&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:21.206026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064f45-1768-47f6-932c-d179bca2fbde None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:21.212008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064f45-1768-47f6-932c-d179bca2fbde None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:21.212008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb064f45-1768-47f6-932c-d179bca2fbde None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:21.212008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 153/311] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:21.214355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:21.214721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:21.214910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:21.235187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:21.236441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:21.281183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:21.362257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 159/312] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:21.675446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb064f45-1768-47f6-932c-d179bca2fbde None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:21.751139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:21.783297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb064f45-1768-47f6-932c-d179bca2fbde None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:21.818142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:21.818775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:21.819054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:21.819325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:21.829945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:21.835416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:21.836337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:21.837124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 154/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:21.842659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:21.949585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb966cc-73ff-4bdf-8b78-2e62a3c9e31c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:21.984703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:21.985310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:21.985589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:21.985860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:21.986514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:21.986819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:21.988217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:21.996580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 160/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:22.005371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:22.108256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791de3-1022-4d6d-b087-9f41c693eb4e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:22.141183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:22.144680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:22.145261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.146365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.146635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] PATH_INFO: `/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.147762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] RBAC: Authorizing `identity:get_user(user_id=2d385ecbe8f54e7ca4c829ddea6b4ffe)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:22.149247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:22.151088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 155/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:22 2022] GET /identity/v3/users/2d385ecbe8f54e7ca4c829ddea6b4ffe => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:22.156762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:22.185295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:22.259657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2b431-c045-4422-a57a-e159b210deb1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:22.294212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:22.294830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.298704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.298704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.364102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:22.365602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:22.392872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:22.465420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 161/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:22.473524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:22.575612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588724e-048a-450e-955a-cc3f60d93fcc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:22.610162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:22.610802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.611081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.611354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.612491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:22.613939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30067c73-518e-4d13-b262-8edb1ce98013 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:22.616463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 156/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:22 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:22.622307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:22.725627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f02e5f-0a4d-46a1-a9e5-351e28a5375f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:22.752806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:22.760874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:22.761486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.761764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.762039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.762769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, scope.project.id=24aea880e5c04f8ebc6e97959354e244, user.id=2d385ecbe8f54e7ca4c829ddea6b4ffe) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:22.768473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:22.768473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517453d-2824-463b-a08a-7acc0989f046 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:22.770753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 162/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:22 2022] GET /identity/v3/role_assignments?user.id=2d385ecbe8f54e7ca4c829ddea6b4ffe&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:22.970882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a76c-fd44-4bc1-b23b-8da1bb0bbb12 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.971094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a76c-fd44-4bc1-b23b-8da1bb0bbb12 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.971375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315a76c-fd44-4bc1-b23b-8da1bb0bbb12 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.972985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 157/319] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:22.978439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360624c-aaf8-4aa2-988e-cc2e8b5a7c4b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:22.978871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360624c-aaf8-4aa2-988e-cc2e8b5a7c4b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:22.979007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360624c-aaf8-4aa2-988e-cc2e8b5a7c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:22.998078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3360624c-aaf8-4aa2-988e-cc2e8b5a7c4b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:22.999268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3360624c-aaf8-4aa2-988e-cc2e8b5a7c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:23.072043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 163/320] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:23.211663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213760c1-3bfb-44e5-b1dd-18afd7ad20ee None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.211987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213760c1-3bfb-44e5-b1dd-18afd7ad20ee None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.212256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213760c1-3bfb-44e5-b1dd-18afd7ad20ee None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.213679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 158/321] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:23.218695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.218997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.219274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.237364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:23.238551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:23.278399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325534e7-31bf-4c9a-8874-b7e2d44c5901 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.278699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325534e7-31bf-4c9a-8874-b7e2d44c5901 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.278952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325534e7-31bf-4c9a-8874-b7e2d44c5901 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.280488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 159/322] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:23.285446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.285730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.286006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.304582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:23.306015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:23.307814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 164/323] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:23.341926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.371310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.376547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 160/324] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:23.395419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.441427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e292c51-9eb8-432b-bd3c-5acfcdedac6b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.479871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.480531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.480810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.481074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.491399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:23.496163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:23.497042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:23.497852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:23.500223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 165/325] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:23.502882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.576348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.600455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794f26f-147e-41cb-9b8e-64c5ca20656c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.636928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.637652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.637937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.638363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.639331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:23.639639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:23.641448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:23.650307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 161/326] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:23.652834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.680039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e52dd-c881-4a62-9805-81c557632c8a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.693031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.709809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.713292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.713910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.714186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.714502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.727641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:23.732695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:23.733723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 166/327] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:23.735004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.751900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca4e25-30c5-4029-9523-51ab896e65a9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.785732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.786873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.787148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.787414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.788507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:23.790221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:23.791765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 162/328] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:23.792546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.832035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e299e-8e42-46be-850e-6e449ca6b890 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.865285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.866006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.866356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.866690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] PATH_INFO: `/v3/users/85fe99afe73e4dd18858b40d34ba73cd` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.867826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] RBAC: Authorizing `identity:get_user(user_id=85fe99afe73e4dd18858b40d34ba73cd)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:23.869300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:23.870868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 167/329] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/users/85fe99afe73e4dd18858b40d34ba73cd => generated 293 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:23.871620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.893531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a75e8c-c9d1-46ff-a128-2059c27ea80a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:23.911770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.919583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:23.927348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:23.927979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:23.928257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:23.928528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:23.929179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:23.929485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:23.930849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:23.939573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 163/330] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:23.940387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:23.974243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8cc8-dd7b-422c-abe2-51f52f9059c8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:24.006505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:24.007758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:24.008086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:24.008364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] PATH_INFO: `/v3/groups` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:24.008995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:24.010422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:24.035681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3a23b-6d76-4b62-a3d9-91aff0bbed22 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:24.068335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:24.068933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:24.069206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:24.069473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:24.070237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] RBAC: Adding query filter params (role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, user.id=85fe99afe73e4dd18858b40d34ba73cd, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:24.070538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:24.071959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:24.083430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 164/331] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 13:41:23 2022] GET /identity/v3/role_assignments?user.id=85fe99afe73e4dd18858b40d34ba73cd&scope.system=all&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 510 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:24.085393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:24.119203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 168/332] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Sep 23 13:41:23 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:24.151878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:24.215049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eedfcf-eeab-44ce-8ca0-56add2882ffe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:24.256070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:24.257058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:24.257521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:24.257942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] PATH_INFO: `/v3/users/6fb21312236747a7a6feaabacc184630` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:24.259372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb21312236747a7a6feaabacc184630)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:24.261101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1da4c1-ddd7-47a2-a719-8b72e57ddb37 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:24.267545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 165/333] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:24 2022] GET /identity/v3/users/6fb21312236747a7a6feaabacc184630 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:24.269103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:24.378390 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:24.381816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557589dc-638c-4d91-ad9a-d49b66f0f54c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:24.415770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:24.416457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:24.416740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:24.417013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] PATH_INFO: `/v3/system/users/6fb21312236747a7a6feaabacc184630/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:24.418425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6fb21312236747a7a6feaabacc184630, role_id=5dabfef5ca6a4ecbb6b855e06c2f3c8b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:24.419797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929fb70-891f-41df-a1b4-19fa6ba33df0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:24.490023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 169/334] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Sep 23 13:41:24 2022] PUT /identity/v3/system/users/6fb21312236747a7a6feaabacc184630/roles/5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:26.486781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4311-48fe-4d2e-a791-11edc26b2a83 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:26.487713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4311-48fe-4d2e-a791-11edc26b2a83 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:26.488221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d4311-48fe-4d2e-a791-11edc26b2a83 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:26.490550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 166/335] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:26.498349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be561e8-2383-483f-9c1c-d6901aa3d84d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:26.499271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be561e8-2383-483f-9c1c-d6901aa3d84d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:26.499741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be561e8-2383-483f-9c1c-d6901aa3d84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:26.525453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4be561e8-2383-483f-9c1c-d6901aa3d84d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:26.527000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4be561e8-2383-483f-9c1c-d6901aa3d84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:26.616780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 170/336] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:26.905479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75af2-38dc-4984-8272-339148f06a61 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:26.906162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75af2-38dc-4984-8272-339148f06a61 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:26.906644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f75af2-38dc-4984-8272-339148f06a61 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:26.908241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 167/337] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:26.913862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:26.914409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:26.914896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:26.934607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:26.936171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:27.022936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 171/338] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:27.083340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f75af2-38dc-4984-8272-339148f06a61 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:27.206732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f75af2-38dc-4984-8272-339148f06a61 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:27.225286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:27.243518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:27.244181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.244457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.244771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.259411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:27.264490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:27.265397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:27.266690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 168/339] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:27.271878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:27.311259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:27.388129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:27.413030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aae499-540c-4ede-a737-7526a7d130f1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:27.461719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:27.461719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.461719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.462016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.462488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:27.462793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:27.465449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:27.478060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 172/340] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:27.484135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:27.560897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad289f0-bf0d-4f5c-807f-4c2265aae251 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:27.626164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:27.631593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:27.632530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.632992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.633462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.643357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6ae2b-0e6f-46df-8bf0-f072357c617a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:27.649590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8845c53d-de17-48b1-ba4d-88be600710b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:27.656663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:27.657542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 23 13:41:27.658299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:27.658926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 169/341] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:27.660071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebb1e-a4e8-4d44-b88e-f75482c15de9 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.660071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebb1e-a4e8-4d44-b88e-f75482c15de9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.660306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837ebb1e-a4e8-4d44-b88e-f75482c15de9 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.661840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 170/342] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:27.663278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4627a7-113a-4bd7-8987-dce7d10bae23 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.663628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4627a7-113a-4bd7-8987-dce7d10bae23 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.664003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4627a7-113a-4bd7-8987-dce7d10bae23 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.665684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 171/343] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:27.669136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4627a7-113a-4bd7-8987-dce7d10bae23 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:27.688868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:27.689496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.689779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.690113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.718024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:27.780118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:27.781966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ba9d5-fa25-4731-b088-cc1c81ccab43 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:27.813078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4627a7-113a-4bd7-8987-dce7d10bae23 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:27.858877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:27.859492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.859801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.860102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.860790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:27.861091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:27.862540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8d6fa-1493-45d6-9dfe-30613e5951ec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:27.875853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 172/344] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:27.875853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.875853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.875853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.893611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:27.894875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:27.896972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:27.918158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 173/345] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:27.920589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:27.921061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:27.921658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:27.946065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:27.947579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:27.980695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 173/346] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:27.981359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.015135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:28.039051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 174/347] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:28.039051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.138811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e466-13a0-4bd9-8f13-fb3c1326094a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.204022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.204661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.204933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.205200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] PATH_INFO: `/v3/users/6fb21312236747a7a6feaabacc184630` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.207219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] RBAC: Authorizing `identity:get_user(user_id=6fb21312236747a7a6feaabacc184630)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:28.208717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:28.214769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 174/348] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:41:27 2022] GET /identity/v3/users/6fb21312236747a7a6feaabacc184630 => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:28.220793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.225934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a126d-216a-42f1-b75f-8f9e4f976d7a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.260034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:28.308984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.309984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.310466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.311054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.312631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:28.314288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:28.316336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 175/349] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:28.322810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.360301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:28.362842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045397d-ccb5-43d7-bb05-bd1982b92122 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.405638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.406265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.406543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.406817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.407542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] RBAC: Adding query filter params (role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b, user.id=6fb21312236747a7a6feaabacc184630, scope.system=all) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:28.407849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:28.409308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1daf1-22fe-44d9-b5c5-aef6f7791507 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:28.426523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 175/350] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/role_assignments?user.id=6fb21312236747a7a6feaabacc184630&scope.system=all&role.id=5dabfef5ca6a4ecbb6b855e06c2f3c8b => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:28.428846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834c1-c1a3-441a-82fa-6fbec801954d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.429134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834c1-c1a3-441a-82fa-6fbec801954d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.429409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add834c1-c1a3-441a-82fa-6fbec801954d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.431225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 176/351] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:28.437067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.437615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.457462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:28.459297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:28.483352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455ca27-d2e4-4177-a844-23afd42a7ac2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.527506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.528391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.528680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.528956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.539641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:28.541956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:28.543615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 176/352] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:28.544528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.577883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 177/353] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:28.579675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.603530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:28.684292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:28.704274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f6610-534e-4bbf-932f-3ad68ff77f96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.705914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372abd17-64f6-457b-b9db-0ee74a084708 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.747786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.749029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.749502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.749993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.751342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:28.752065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:28.753857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:28.762170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 178/354] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:28.763185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.763334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.764221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.764740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.765219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:28.785206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:28.792824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:28.793790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:28.794589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:28.797014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 177/355] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:28.803389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:28.922179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f429886-2666-4f7c-851d-8ad80772f51f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.983129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:28.983907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:28.984238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:28.984338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13335e11-fb27-4461-b35e-5a72a8a836ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:28.984510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.008945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.010201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:29.016149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:29.017264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:29.018234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:29.021307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 179/356] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:29.038029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.051974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.055773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.056787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.057071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.057348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.058055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:29.058339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.059773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.069971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 178/357] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:29.070817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.159653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a4ee-2bb8-41ef-973d-895d19d11be7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.198550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.199170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.199446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.199713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.200074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365184f-a519-44b4-81a8-12c960e40f36 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.200406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:29.200706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.203895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.212738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 180/358] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:29.213641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.247126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.248159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.248659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.249241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.264237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:29.271879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:29.272784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:29.273558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:29.276850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 179/359] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:29.280647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.319724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.325974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.355161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dce53-7ff6-4639-af7a-d662f015c522 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.411766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.412708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.413187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.413728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.417455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e61b05-f77f-4e4b-a3b0-5e8d769e8340 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.474615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.475129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.475507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.475891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.503232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.505395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.570940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.573772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d0685-411a-48b1-998f-5f70d78da4c0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.588945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.604778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.627761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 181/360] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:29.628885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.717851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 180/361] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:29.717851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72fce-d461-48f6-a836-ae97c5cd9ae8 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.717851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72fce-d461-48f6-a836-ae97c5cd9ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.717851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c72fce-d461-48f6-a836-ae97c5cd9ae8 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.720057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 181/362] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:29.720916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c72fce-d461-48f6-a836-ae97c5cd9ae8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.765238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41f0e3-b335-4f15-be38-96946f2eaa87 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.803473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.804117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.804394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.804761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.805314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:29.805614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.807085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.815271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 182/363] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:29.819941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:29.857617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c72fce-d461-48f6-a836-ae97c5cd9ae8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:29.859408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.897173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:29.903530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:29.904252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.904641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.904923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.906223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:29.907680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c49ec41-c0e2-4eaa-9f36-ce7029c111f0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:29.912022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 182/364] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:29.912022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:29.912022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:29.912022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:29.938125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:29.939983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:29.951854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7dd62-1544-4e59-867a-54efbe5d4abd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.007468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.008162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.008447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.008723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.010338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.011803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.013540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 183/365] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:29 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.014323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.026460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 183/366] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:30.027624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.137479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621643f-6d4c-4e1d-bd65-f197afac77ec None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.151717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.156910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2675-ce9a-4a02-bc5f-574afc7aa00f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.170417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.181058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.181698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.181977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.182297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.183784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.185975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.188064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 184/367] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.189864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.203335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.204839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.205333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.205786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.300178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.302081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.315071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80e271-ecf3-4842-b3c6-548a7ec99e17 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.355405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.356162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.356375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.356652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.357768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.359232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.361057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 185/368] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.361831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.428767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.431952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 184/369] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:30.432963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.459219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.510534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c7f78-5ac5-4d3a-b0dd-b2750a554e0e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.552645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.553605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.554103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.554569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.555487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:30.556023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.557544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.564753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 186/370] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.565662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.565945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d37e88-1f35-460c-a384-8ba6025cb8ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.616803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.617452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.617850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.618188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.633609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:30.640702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:30.641756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:30.642769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:30.643420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.718040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc12276-96b3-4339-8b39-eee8c85687fb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.741358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.756585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:30.766562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.767247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.767530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.767801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.768640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=24aea880e5c04f8ebc6e97959354e244) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:30.768954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.770619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.780200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 187/372] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.781197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.809777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae99133-0ccd-415f-a437-cb98f80d2896 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.884490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.885140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.885415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.885682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.892934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.894617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.896455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 186/373] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.902347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:30.904418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d91e3-a363-4ce1-8f2e-40ee593f527f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:30.945852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:30.946542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:30.946845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:30.947868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:30.948727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:30.949050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:30.950503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:30.960376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 188/374] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:30.967162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:31.033692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:31.085304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d446c37-c9c6-42b3-8d98-b513348d6c36 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:31.126364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:31.127018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.127299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.127624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.135659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e7461-4052-4134-b56b-88b61bcd58a5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:31.172326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:31.182901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:31.183564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.183845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.184167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.186182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:31.187872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:31.190122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 187/375] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:31.197969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:31.212444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:31.213917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b90e5-5a4c-4125-a3bd-32d43e801503 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:31.272976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:31.327489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 189/376] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:31.328793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9522aa-d44a-44eb-83a7-ae1f29882e6a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.329082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9522aa-d44a-44eb-83a7-ae1f29882e6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.329350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9522aa-d44a-44eb-83a7-ae1f29882e6a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.330573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 190/377] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:31.336783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9522aa-d44a-44eb-83a7-ae1f29882e6a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:31.360557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66d5d8-6465-49f4-aae6-135e74292262 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:31.403547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:31.404198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.404478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.404752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.405477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=24aea880e5c04f8ebc6e97959354e244) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:31.405784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:31.408544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7fc66-9037-494a-92c8-b06d4284fcb9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:31.416765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 188/378] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:31 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:31.418427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.418871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.419152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.443451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:31.444898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:31.488768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9522aa-d44a-44eb-83a7-ae1f29882e6a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:31.536956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:31.549365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 189/379] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:31.584874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:31.585447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.585723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.585988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] PATH_INFO: `/v3/projects/9de1115a66a14d16b7a8fe9cccd73591` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.587214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] RBAC: Authorizing `identity:get_project(project_id=9de1115a66a14d16b7a8fe9cccd73591)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:31.588672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:31.590518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 191/380] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:31 2022] GET /identity/v3/projects/9de1115a66a14d16b7a8fe9cccd73591 => generated 344 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:31.596427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:31.740162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318448e-c02c-4ae4-8602-ae8ead8ab43c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:31.789640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:31.790550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:31.790841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:31.791097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] PATH_INFO: `/v3/groups/11b680924d694340a87bfff471c5a156` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:31.802160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] RBAC: Authorizing `identity:get_group(group_id=11b680924d694340a87bfff471c5a156)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:31.803626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:31.805521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 190/381] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:31 2022] GET /identity/v3/groups/11b680924d694340a87bfff471c5a156 => generated 229 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:31.811118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:31.852086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:31.970417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ac590-5c63-4fba-a401-65e13d2019de None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:32.005642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:32.013081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:32.013699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:32.013976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:32.014245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:32.014972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] RBAC: Adding query filter params (group.id=11b680924d694340a87bfff471c5a156, role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=9de1115a66a14d16b7a8fe9cccd73591) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:32.015277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:32.016733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:32.023995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 192/382] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:31 2022] GET /identity/v3/role_assignments?group.id=11b680924d694340a87bfff471c5a156&scope.project.id=9de1115a66a14d16b7a8fe9cccd73591&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:32.099894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:32.168853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a180-be17-41de-b04a-a249a2a03c8f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:32.212168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:32.212850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:32.213128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:32.213402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:32.227680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:32.233214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:32.234098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:32.234883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 191/383] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:32.240899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:32.377862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:32.396681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb088e3-985f-44c9-9ae3-d23f03113036 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:32.440325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:32.440917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:32.441202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:32.441475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:32.442831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:32.443136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:32.444650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:32.465562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:32.470413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 193/384] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:32.615325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0b888-6882-429e-961a-83ad52c44df2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:32.629757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:32.653923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:32.654571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:32.654856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:32.655136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:32.660668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:32.662677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:32.664652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:32 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:32.670267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:32.841394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294195c-76cc-4b4b-a5c6-b09b1236d85d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:32.889983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:32.890632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:32.890911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:32.891187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:32.892360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:32.893797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c7651-6df4-4b8f-8491-35819955df6f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:32.895492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:32 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:32.904983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:33.056404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe023b-04c2-4b59-adf6-0d245fcfa07b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:33.105535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:33.106131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:33.106414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:33.106693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/groups/c15fe47f408f4664ba5a12edf621edae/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:33.108631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, group_id=c15fe47f408f4664ba5a12edf621edae, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:33.110077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b768334-1f03-46ac-bf1e-8fc1ed73a775 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:33.199874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 193/387] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 13:41:32 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/groups/c15fe47f408f4664ba5a12edf621edae/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:33.430028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b66-3efe-4d4e-84df-319825f6169e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:33.430541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b66-3efe-4d4e-84df-319825f6169e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:33.430978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e87b66-3efe-4d4e-84df-319825f6169e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:33.432499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 195/388] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:33.438155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3d242-4020-4f30-9324-8058bbc6cd69 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:33.438623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3d242-4020-4f30-9324-8058bbc6cd69 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:33.439050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3d242-4020-4f30-9324-8058bbc6cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:33.465281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8ad3d242-4020-4f30-9324-8058bbc6cd69 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:33.466739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ad3d242-4020-4f30-9324-8058bbc6cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:33.512112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:33.551622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 194/389] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:33.854206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87b66-3efe-4d4e-84df-319825f6169e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:33.877452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:33.965186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc194f-15a2-41f5-9aad-2c45ab9e3175 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:33.966218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc194f-15a2-41f5-9aad-2c45ab9e3175 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:33.966702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc194f-15a2-41f5-9aad-2c45ab9e3175 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:33.968684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 195/390] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:33.974725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510c71-5fad-49eb-88a7-6c53fc20ca1d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:33.975024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510c71-5fad-49eb-88a7-6c53fc20ca1d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:33.975292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9510c71-5fad-49eb-88a7-6c53fc20ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:33.987995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e87b66-3efe-4d4e-84df-319825f6169e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.028427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.028752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9510c71-5fad-49eb-88a7-6c53fc20ca1d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:34.029059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.029338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.029611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.029949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9510c71-5fad-49eb-88a7-6c53fc20ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:34.041592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:34.047119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:34.048061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:34.048883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 196/391] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:34.056967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.148376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:34.173287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab42-1278-4abb-9d47-0fe60425d6c2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.188826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 196/392] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:34.190272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8519ac2-2685-4cf4-ab78-69211d4090d2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.190565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8519ac2-2685-4cf4-ab78-69211d4090d2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.190842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8519ac2-2685-4cf4-ab78-69211d4090d2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.197007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 197/393] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:34.198336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.198723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.199161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.216675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.217295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.217579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.217894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.218571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:34.218879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:34.220230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:34.220568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:34.221791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:34.229760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 197/394] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:34.238299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.356366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 198/395] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:34.391746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc8d363-5ef2-4aa5-a678-fb657284b6fd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.429190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.429791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.430077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.430356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.431496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:34.433052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:34.435165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 198/396] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:34.443858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.492935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:34.527807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.544966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:34.615260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edada183-9c12-4aac-9ec8-82fac202c1de None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.686595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.687161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.687442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.687717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.689033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:34.690504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:34.692903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 199/397] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:34.698842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.730426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e60e62-8aed-48b5-993e-0cd5f25fa9cf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.773516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.774147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.774427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.774695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.784620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-241326f7-fc03-49e5-97e0-c892f9ee7e65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:34.790797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:34.791688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:34.792882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 199/398] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:34.793542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250fa5-1213-4394-8940-bf261bd92638 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.793542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250fa5-1213-4394-8940-bf261bd92638 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.793542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250fa5-1213-4394-8940-bf261bd92638 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.794897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 200/399] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:34.799289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250fa5-1213-4394-8940-bf261bd92638 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.813901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:34.817594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d207f2-2492-468d-8173-b4d1eb07272c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.857836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.858536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.858815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.859087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/groups/c15fe47f408f4664ba5a12edf621edae/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.861409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b11e81c6e464f8292f3dbe8c5c6202e, group_id=c15fe47f408f4664ba5a12edf621edae, role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:34.862869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:34.870620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:34.905272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250fa5-1213-4394-8940-bf261bd92638 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:34.938397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:34.938920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.939202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.939476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.948023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 200/400] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 13:41:34 2022] PUT /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e/groups/c15fe47f408f4664ba5a12edf621edae/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:34.948023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:34.960886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fb5ba8db-20ad-4296-8bbc-aab1dacb2679 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:34.966764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:34.968004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:34.968804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 201/401] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:34.969461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:34.969872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:34.969872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:34.992190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:34.993429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:35.073868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88405381-a6aa-41be-b384-fe29f9d05292 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.083187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 202/402] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:35.084326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.153502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.154706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.156462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.156894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.157317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.159273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:35.160370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.162320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.171751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 201/403] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:35.178117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.217204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.218032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1e3e7-ec3a-4470-b6e3-d878206c2380 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.261017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.261640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.261925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.262203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.262875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:35.263210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.267236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.278037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 203/404] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:35.283544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.316919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e25b6-e047-4b90-9943-a9780a49e05b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.360143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.361685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.362608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.363093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.364827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.367522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.369896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 202/405] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:35.376031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.458346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6743229-bcc3-431a-b7c2-6590f1f96e34 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.478373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.499184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.499843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3b729-2413-46e8-99e1-79af143841d2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.500378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.500812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.501486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.502807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.504467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.506794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 204/406] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:35.507850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.510996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.543852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.544785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.545135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.545485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.546685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.548523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.554967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 203/407] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:35.554967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.630572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620bb6a-7358-4746-ab08-cb3f397c05e8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.661570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f9479-5fbc-4180-9f6a-1d8aedf56c1e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.666208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.667075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.667555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.668042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.679402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:35.685269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:35.686172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:35.686960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:35.689688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 205/408] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:35.690657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.702910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.704401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.705199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.705969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.707502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.710461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.713157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 204/409] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:35.714190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.743725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.756871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:35.818216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9169765-3f30-4df0-863f-999d53541760 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.837899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d89db8a-659c-4295-8ecc-59367186c560 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:35.862847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.863741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.864236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.864529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/groups/c15fe47f408f4664ba5a12edf621edae/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.866900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, group_id=c15fe47f408f4664ba5a12edf621edae, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.869273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.881401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:35.882486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:35.883032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:35.883555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:35.884504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:35.885146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:35.886879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:35.902386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 205/410] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:35.902386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:35.958499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 206/411] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 13:41:35 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/groups/c15fe47f408f4664ba5a12edf621edae/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:35.960532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:36.035534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:36.057421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f02125-9c29-48c9-9b76-288060bc5600 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:36.104355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:36.105122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.105370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.105576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244/groups/c15fe47f408f4664ba5a12edf621edae/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.108453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] RBAC: Authorizing `identity:create_grant(project_id=24aea880e5c04f8ebc6e97959354e244, group_id=c15fe47f408f4664ba5a12edf621edae, role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:36.110737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802596e7-44c1-409c-b7b3-058b7ebec552 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:36.112413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1fbf3-b297-498f-b811-629fbc035d96 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:36.123319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:36.154916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:36.155564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.155869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.156242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] PATH_INFO: `/v3/groups/11b680924d694340a87bfff471c5a156` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.157617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] RBAC: Authorizing `identity:get_group(group_id=11b680924d694340a87bfff471c5a156)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:36.159191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b73627-c0ba-4306-a312-00eae57208d9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:36.161762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 207/412] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:35 2022] GET /identity/v3/groups/11b680924d694340a87bfff471c5a156 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:36.163089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08bd2-1b56-4f67-968d-449a2fad9b5d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.164441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08bd2-1b56-4f67-968d-449a2fad9b5d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.164441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb08bd2-1b56-4f67-968d-449a2fad9b5d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.165428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 208/413] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:36.169989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 206/414] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 13:41:35 2022] PUT /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244/groups/c15fe47f408f4664ba5a12edf621edae/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:36.170925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08bd2-1b56-4f67-968d-449a2fad9b5d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:36.171985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.172420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.172705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.196003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:36.198686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:36.344714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 207/415] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:36.355782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb08bd2-1b56-4f67-968d-449a2fad9b5d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:36.395629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:36.396303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.396581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.396851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] PATH_INFO: `/v3/projects/9de1115a66a14d16b7a8fe9cccd73591` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.397993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] RBAC: Authorizing `identity:get_project(project_id=9de1115a66a14d16b7a8fe9cccd73591)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:36.399419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:36.401483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 209/416] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:36 2022] GET /identity/v3/projects/9de1115a66a14d16b7a8fe9cccd73591 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:36.407647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:36.522991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:36.546095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e93b60-4905-40bd-9b99-2b089bcd3797 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:36.581524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:36.582198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.582477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.582785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] PATH_INFO: `/v3/projects/9de1115a66a14d16b7a8fe9cccd73591/groups/11b680924d694340a87bfff471c5a156/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.584831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9de1115a66a14d16b7a8fe9cccd73591, group_id=11b680924d694340a87bfff471c5a156, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:36.586377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:36.668549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 208/417] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Sep 23 13:41:36 2022] PUT /identity/v3/projects/9de1115a66a14d16b7a8fe9cccd73591/groups/11b680924d694340a87bfff471c5a156/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:36.817656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:36.876711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:36.946479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e01e25-67fc-457e-8270-22faa5bd620a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:36.983946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:36.984716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:36.984958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:36.985235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:36.996989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:37.002664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:37.003556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:37.004383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 210/418] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:37.011082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:37.172302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207d76-858d-4f23-a5bf-97b2b49c75d5 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:37.223951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:37.224795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:37.225214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:37.225653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:37.226458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:37.226897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:37.228432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517744c2-bd4c-4db2-9859-6b975ce0d5e2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:37.236188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:37.240607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 209/419] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:37.246483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:37.387076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb68fa5-c8c9-4842-9419-b0add7c02601 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:37.388623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:37.421514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:37.422149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:37.422434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:37.422710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:37.524322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:37.525719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:37.586237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a406d-4688-4050-bf62-1ff0617dc07d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:37.586521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a406d-4688-4050-bf62-1ff0617dc07d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:37.586792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a406d-4688-4050-bf62-1ff0617dc07d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:37.591701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 210/420] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:37.593742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:37.594022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:37.594293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:37.615931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:37.617144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:37.674182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 211/421] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:37.680150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:37.682235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:37.753637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 211/422] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:37.846843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4613-5b73-420f-b2b6-0a9e7b39f9c2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:37.890661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:37.891288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:37.891568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:37.891837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:37.892984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:37.894402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:37.896377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:37 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:37.904301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.046720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec724da8-5db1-4f29-8292-fa8cfaf29892 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:38.099342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:38.099974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.100261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.100535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.102000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.103726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:38.109450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:38.116178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:38.118284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 212/424] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:37 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:38.121771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.193831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:38.246628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff76d5e-06ca-4804-a07d-31b5467b0ddf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:38.302165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe3b10-b485-4339-bdd0-024cb52f0137 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:38.314647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:38.315288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.315564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.315828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.333837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:38.338649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:38.339495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:38.340873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 213/425] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:38.350133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.374048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:38.374659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.374934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.375203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.375941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:38.376254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:38.377684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:38.400378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 213/426] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:38 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 611 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:38.485314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a61834-ba9b-41ee-a45f-3585a3b2f0fe None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:38.516348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:38.525582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:38.526222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.526499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.526768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.527453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:38.527756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:38.529198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86706ad7-fee9-4d66-aa55-ac0d0794b180 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:38.544162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 214/427] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:38.553108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.659022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:38.707668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f89cf-59b3-47e7-b6a7-c437d2319c0f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:38.730640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55b20-e2cb-4bb4-90d9-48273f6d90f1 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.730943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55b20-e2cb-4bb4-90d9-48273f6d90f1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.731201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f55b20-e2cb-4bb4-90d9-48273f6d90f1 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.732850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 215/428] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:38.738331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97f1e-9688-456c-a022-88b5da618220 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.738625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97f1e-9688-456c-a022-88b5da618220 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.738950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b97f1e-9688-456c-a022-88b5da618220 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.740280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 216/429] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:38.741306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586681d-cc8f-43ac-8937-17ce8c22b576 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.741592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586681d-cc8f-43ac-8937-17ce8c22b576 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.741870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586681d-cc8f-43ac-8937-17ce8c22b576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.757987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:38.758974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.759449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.759953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.762476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3586681d-cc8f-43ac-8937-17ce8c22b576 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:38.763795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3586681d-cc8f-43ac-8937-17ce8c22b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:38.844640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:38.846101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:38.863980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 217/430] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:38.863980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:38.863980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:38.863980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:38.891434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:38.893301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:38.915513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:38.960133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 214/431] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:38.965881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:38.976176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 218/432] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:39.082266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb2c872-5d96-48fe-9a27-1ddf223a1678 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.119641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.120673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.121179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.121632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] PATH_INFO: `/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.122938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] RBAC: Authorizing `identity:get_project(project_id=1b11e81c6e464f8292f3dbe8c5c6202e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.124644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:39.126774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 215/433] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:38 2022] GET /identity/v3/projects/1b11e81c6e464f8292f3dbe8c5c6202e => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:39.132041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.153286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.190487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.200815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.258999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343159c-e3ae-4598-97d6-913ce133e808 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.269694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78ea6-5094-4447-b57c-9daf1e518b2d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.308699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.309410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.309688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.309968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.311082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.312545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:39.313941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.314576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.314852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.315123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.319729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 219/434] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:39.320911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.328539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:39.334125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:39.334984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 216/435] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:39.336718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.426742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.431088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2f80-c5db-41d0-9b31-8432d607d581 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.435846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d4a41-a0fc-4012-8be3-3aa7e23a0bb9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.451653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.471014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.471278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.471623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.471899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.472006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.472200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.472287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.472473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.472927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:39.473263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.474693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:39.480407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 217/436] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=1b11e81c6e464f8292f3dbe8c5c6202e&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:39.480407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.495139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-21bd6a9a-6408-43e8-ab42-16a3895b091c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:39.500381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:39.501382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:39.502366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 220/437] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:39.503265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031f1d8-d968-4d37-b597-b3870d1ed07f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.503497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031f1d8-d968-4d37-b597-b3870d1ed07f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.506538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031f1d8-d968-4d37-b597-b3870d1ed07f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.506538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 221/438] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:39.511066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031f1d8-d968-4d37-b597-b3870d1ed07f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.600612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608979d3-a634-4fe4-ba5a-9e5618b3af40 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.621941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031f1d8-d968-4d37-b597-b3870d1ed07f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.642723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.643787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.644099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.644420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.645140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:39.645934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.647952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f8dc8-664f-4344-b1d9-2f0a2578f8c1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:39.657448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 218/439] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:39.658743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.659038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.659314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.666978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.668494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.668777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.669042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.669710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:39.670008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.671369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:39.678505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:39.679698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:39.682138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 222/440] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:39.683121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.693188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.737826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.759463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 219/441] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:39.759463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:39.826483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1306f7-27a8-48c9-8b91-a7d8204f7f67 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.868993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513adab-0d94-400b-bcd5-b9a610ec68dd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:39.872673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.873317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.873598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.873871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.906458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:39.908803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:39.908803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:39.908803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:39.928117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:39.966060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:39.967160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.000127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.001578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.014474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.071609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 223/442] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:40.072473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.106922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 220/443] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:40.106922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.147961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.170407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde7ea9-3b0d-448f-bff9-5fec0dcf5a55 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.200988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf89024-90c2-423f-9029-4cfe0060fd13 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.204085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.204712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.204992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.205263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.215113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:40.220142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:40.224871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 224/444] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:40.225714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.226427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.239720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.240384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.240665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.240935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.242207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.243651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.245796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 221/445] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.246054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.324165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037514d-0ad0-4036-900a-719bba245142 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.344655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caebf0-4c68-42b9-b008-71175d9e6f7a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.357265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.357898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.358178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.358452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] PATH_INFO: `/v3/projects/24aea880e5c04f8ebc6e97959354e244` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.358645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.359900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] RBAC: Authorizing `identity:get_project(project_id=24aea880e5c04f8ebc6e97959354e244)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.361375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.363008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 225/446] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/projects/24aea880e5c04f8ebc6e97959354e244 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.363824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.380777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.381384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.381662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.381935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.382595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:40.382892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.384277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.392018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 222/447] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.392789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.435449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.466003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c01f4-7a2f-45f6-b046-ddf3f1508483 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.492532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fa0e4-a740-4bb9-9d65-f80959f00aa0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.500416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.501053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.501327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.501606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.502714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.504182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.505781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 226/448] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.506541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.525967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.526596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.526880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.527156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] PATH_INFO: `/v3/groups/c15fe47f408f4664ba5a12edf621edae` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.528296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] RBAC: Authorizing `identity:get_group(group_id=c15fe47f408f4664ba5a12edf621edae)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.529723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.531407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 223/449] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/groups/c15fe47f408f4664ba5a12edf621edae => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.532183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.577378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.609385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301c6b2-df9f-4051-ba17-5d817fd28bc2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.630329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfb59d-5fad-4372-a421-7872818c9a2a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.643845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.644474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.644750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.645513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.653268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.663156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.663763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.665398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.665398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.665398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=24aea880e5c04f8ebc6e97959354e244) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:40.665619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.667018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.672650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 224/450] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.673419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.720060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.721557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.797561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9d30-e8b3-4448-97c1-fb605105c5e4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.807652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.834084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.834620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.834897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.839675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.839775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 227/451] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:40.839861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] RBAC: Adding query filter params (group.id=c15fe47f408f4664ba5a12edf621edae, role.id=fa11e4e77f274fcfb93ddc58eaf4afd5, scope.project.id=24aea880e5c04f8ebc6e97959354e244) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:40.839861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.839861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.840696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:40.846433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 225/452] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/role_assignments?group.id=c15fe47f408f4664ba5a12edf621edae&scope.project.id=24aea880e5c04f8ebc6e97959354e244&role.id=fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:40.885137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:40.953079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07112a-507f-41cf-9784-eddbdbbe5417 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:40.988423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:40.989113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:40.989393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:40.989665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] PATH_INFO: `/v3/projects/9de1115a66a14d16b7a8fe9cccd73591` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:40.990807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] RBAC: Authorizing `identity:get_project(project_id=9de1115a66a14d16b7a8fe9cccd73591)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:40.992291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:40.994037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 228/453] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/projects/9de1115a66a14d16b7a8fe9cccd73591 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:40.999811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:41.100375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67e2db-e416-44c2-b022-521afb6f6a13 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:41.133695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:41.134332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:41.134613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:41.134889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] PATH_INFO: `/v3/groups/11b680924d694340a87bfff471c5a156` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:41.136023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] RBAC: Authorizing `identity:get_group(group_id=11b680924d694340a87bfff471c5a156)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:41.137474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac9d4d-d37f-4b02-b50e-a6135e8888e4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:41.139033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 226/454] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Sep 23 13:41:40 2022] GET /identity/v3/groups/11b680924d694340a87bfff471c5a156 => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:41.145595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:41.247394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fbaf7-b1af-4728-aacf-2318435dd920 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:41.255333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:41.281977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:41.282596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:41.282885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:41.283156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:41.283885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] RBAC: Adding query filter params (group.id=11b680924d694340a87bfff471c5a156, role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=9de1115a66a14d16b7a8fe9cccd73591) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:41.284293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:41.285755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f4891-60c4-454f-8a61-3ca3129ece4d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:41.291996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 229/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Sep 23 13:41:41 2022] GET /identity/v3/role_assignments?group.id=11b680924d694340a87bfff471c5a156&scope.project.id=9de1115a66a14d16b7a8fe9cccd73591&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:43.807717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ec24-85d2-4149-8250-15ab34aa454b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:43.808263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ec24-85d2-4149-8250-15ab34aa454b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:43.808336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42ec24-85d2-4149-8250-15ab34aa454b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:43.809772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 227/456] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:43.814946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36319e8b-7387-4138-94c3-b70dc0d5f54d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:43.815347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36319e8b-7387-4138-94c3-b70dc0d5f54d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:43.815529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36319e8b-7387-4138-94c3-b70dc0d5f54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:43.840901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-36319e8b-7387-4138-94c3-b70dc0d5f54d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:43.842121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-36319e8b-7387-4138-94c3-b70dc0d5f54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:43.941578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:44.034452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaafa-5a73-4c44-8a32-b98f1abcab8d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.034769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaafa-5a73-4c44-8a32-b98f1abcab8d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.035019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eaafa-5a73-4c44-8a32-b98f1abcab8d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.036982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 228/458] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:44.042690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f148-5783-4b3a-8a19-4308252fa5f7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.042987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f148-5783-4b3a-8a19-4308252fa5f7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.043271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2f148-5783-4b3a-8a19-4308252fa5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.066060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b4c2f148-5783-4b3a-8a19-4308252fa5f7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:44.067230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b4c2f148-5783-4b3a-8a19-4308252fa5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:44.161786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 231/459] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:44.248379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b891-2ce1-4650-b74a-661c8e26ab6b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.248698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b891-2ce1-4650-b74a-661c8e26ab6b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.248942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36b891-2ce1-4650-b74a-661c8e26ab6b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.250292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 229/460] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:44.255604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.255897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.256201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.257382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36b891-2ce1-4650-b74a-661c8e26ab6b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.298797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:44.300030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:44.336340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:44.357225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:44.441150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 232/461] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:44.447881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36b891-2ce1-4650-b74a-661c8e26ab6b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:44.484177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:44.484824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.485106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.485381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.496281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:44.497757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:44.512320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:44.513220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:44.514055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:44.514055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.514055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:44.514055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 230/462] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:44.519592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.534868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.689921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49759372-5ad3-41b6-a7d1-df18a7c4ce63 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:44.698719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:44.719483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdfb6c-4955-4637-a460-10a62f84a652 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:44.752121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:44.752747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.755036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.757274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.758008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:44.758317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:44.759727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:44.781011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 233/463] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:44.782138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.793778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:44.794414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.794689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.794960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.810529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:44.811482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:44.812454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:44.833478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:44.834401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:44.835232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:44.835232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.835232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:44.839955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 231/464] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:44.839955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.898150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d21df-6049-44a7-bc59-147cf7452037 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:44.934193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:44.934816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.935094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.935363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.947220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:44.948628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:44.948732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908c0f5-9c83-435a-ab41-902cdcd872d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:44.964120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:44.965069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:44.965892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:44.965892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:44.965892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:44.965892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 234/465] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:44.966113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:44.984718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:44.985330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:44.985765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:44.986044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:44.986682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:44.988130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e795c-87c7-4c89-88a2-e1394d2c9045 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.039056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.069517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e11bbf-4c14-4ec6-942a-9c350c760d55 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.073268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.078425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 232/466] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:44 2022] POST /identity/v3/users => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:45.079865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d52cb-57bf-421e-8314-1236d833ec14 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.084053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d52cb-57bf-421e-8314-1236d833ec14 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.084053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d52cb-57bf-421e-8314-1236d833ec14 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.084053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 233/467] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:45.084053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d52cb-57bf-421e-8314-1236d833ec14 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.117927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.118577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.118862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.119136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.119794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:45.120145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.121676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d6094-c53d-42aa-bbed-218c4ebe1c33 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.135278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 235/468] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:45.135278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.135278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.135278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.158913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:45.161096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:45.222592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d52cb-57bf-421e-8314-1236d833ec14 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.254879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 236/469] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:45.256524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.274960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.275894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.276407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.276879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.278097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:45.279017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.282410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.305421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 234/470] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:45.310798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.351906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.386633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.390975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bedc65-909a-4992-9a26-5ab80b817ac4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.428414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.429203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.429586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.429956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.430713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.432350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74150ab-9f00-4961-9196-bee812b0c7eb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.441969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fffb0-cff8-49db-bacd-f59cba1f8219 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.498698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.500322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.500322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.500322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.500723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.503204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.550924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 237/471] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:45 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:45.553206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38292343-5401-4494-b12e-146634dd8c1e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.553496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38292343-5401-4494-b12e-146634dd8c1e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.553764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38292343-5401-4494-b12e-146634dd8c1e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.555035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 238/472] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:45.561475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.561922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.562260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.583633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:45.584907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:45.596254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 235/473] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:45 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:45.597546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.670034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 239/474] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:45.728131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78c364-25f1-4016-bc3d-d357e1cd42fe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.750123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.769372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.770579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.770862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.771135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.783391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.785129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:45.803244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:45.804217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:45.805732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:45.805732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:45.805732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:45.805732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 236/475] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:45.810709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.876609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:45.934590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781ca2d-3ea1-482a-8102-51b90766427a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:45.965815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:45.978941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:45.979789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:45.980262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:45.980675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:45.981795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:45.982261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:45.984375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:45.998525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 240/476] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:46.003905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:46.117284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6830c-5163-4026-ab73-3975efcf554e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:46.120204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162f9057-b7a4-46df-9c40-90a17da73ce3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:46.130740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:46.157807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:46.158762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:46.159276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:46.159738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:46.160641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:46.162287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:46.167683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:46.168337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:46.168623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:46.168901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:46.169580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:46.170977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:46.231548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.sql.core [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 13:41:46.231548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 13:41:46.231548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [parameters: {'id': '0289ce41ebec45d2b274e0a021f8b9a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 13:41:46.231548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81863) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 13:41:46.255789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:46 2022] POST /identity/v3/users => generated 249 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 23 13:41:46.257468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return ref.to_dict() Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:41:46.264472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application yield resource Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise self.value Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application session.commit() Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 13:41:46.265568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.flush() Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application compat.raise_( Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 13:41:46.266641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:41:46.267665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:41:46.268744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [parameters: {'id': '0289ce41ebec45d2b274e0a021f8b9a8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:46.269679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 23 13:41:46.271274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:46.276390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 13:41:45 2022] POST /identity/v3/roles => generated 144 bytes in 294 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:46.276483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:46.438103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d157be7-2f4b-49a7-87c2-28223c735a56 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:46.478449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:46.479151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:46.479434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:46.479704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:46.492165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6f3560cf-68e6-433a-a5ac-75dde7379028 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:46.497725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:46.499653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:46.500717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:41:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:46.505452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:46.582254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:46.671198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba623c9-a6f8-4249-ac18-a491c37d2d09 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:46.719134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:46.719760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:46.720073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:46.720351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:46.721019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:46.721325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:46.722707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d460b7-703a-4468-9904-0d4e1af76ae1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:46.733959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:47.767934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68364-b015-4ec4-80d1-53db5af837bc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:47.768475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68364-b015-4ec4-80d1-53db5af837bc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:47.768475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c68364-b015-4ec4-80d1-53db5af837bc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:47.770663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:47.775654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a783-eb87-4577-b066-488267fe6d77 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:47.776075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a783-eb87-4577-b066-488267fe6d77 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:47.776240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a783-eb87-4577-b066-488267fe6d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:47.796855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c730a783-eb87-4577-b066-488267fe6d77 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:47.798029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c730a783-eb87-4577-b066-488267fe6d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:47.884450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:48.230062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178187-c613-4172-a5ac-1cab4ab990ca None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.230062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178187-c613-4172-a5ac-1cab4ab990ca None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.230062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8178187-c613-4172-a5ac-1cab4ab990ca None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.230062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 244/483] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:48.233683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.233978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.234240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.262665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:48.263858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:48.286697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:48.301830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8178187-c613-4172-a5ac-1cab4ab990ca None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:48.354073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:48.390847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:48.476003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8178187-c613-4172-a5ac-1cab4ab990ca None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:48.523552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577404-6fec-4c22-9b14-668007785749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:48.524133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577404-6fec-4c22-9b14-668007785749 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.524408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577404-6fec-4c22-9b14-668007785749 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.524677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577404-6fec-4c22-9b14-668007785749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.535324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27577404-6fec-4c22-9b14-668007785749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-27577404-6fec-4c22-9b14-668007785749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:48.547749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:48.548651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:48.549442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 245/485] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:48.556918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:48.583159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99fbef-9f46-490a-8162-d88762fc9983 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.583488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99fbef-9f46-490a-8162-d88762fc9983 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.583713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99fbef-9f46-490a-8162-d88762fc9983 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.585332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 246/486] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:48.592993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.593289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.593553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.616347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:48.617545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:48.693083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648bd55-9274-4b62-b6f6-021bcae4cf93 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:48.751471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:48.752130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.752414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.752688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.753417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:48.753721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:48.755174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:48.758977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 247/487] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:48.759893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:48.764040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 241/488] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:48.769469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:48.797002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:48.813095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:48.908375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92ea5-b0db-4171-be10-fb52906a6a0f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:48.947151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:48.948111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:48.948582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:48.949134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:48.962225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:48.963990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:48.980835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:48.981970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:48.983045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:48.983045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:48.983045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:48.985123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 242/489] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:48.992966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.031349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab421397-87fc-4be8-8e98-f25320bd5dc2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.095772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.096155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.096432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.096704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.107368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:49.112167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:49.113037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:49.113882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 248/490] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:49.114524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.116168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.154496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731ce0-5423-486d-b82c-13802860e3b6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.189437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.190046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.190327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.190601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.191238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:49.191544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.193491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.196616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.210484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 243/491] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:49.210484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.232493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51771e49-93dd-4f38-9195-1ebeb0518a22 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.269557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.270820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.271119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.271381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.281464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-05a3b3cb-b2fa-49c4-a56e-28f7cc6ecc95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:49.286281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:49.287335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:49.288146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 249/492] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:49.288810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133ab9-4d9d-43b7-9ef5-7a51aa1a2644 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.288877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133ab9-4d9d-43b7-9ef5-7a51aa1a2644 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.289117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb133ab9-4d9d-43b7-9ef5-7a51aa1a2644 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.291209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 250/493] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:49.292678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb133ab9-4d9d-43b7-9ef5-7a51aa1a2644 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.322037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14ee42-d445-42d3-819e-4324fcf74c0d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.354833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.362644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.363254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.363547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.363826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.365326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:49.365326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.366217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.374015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 244/494] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:49.374724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.404856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb133ab9-4d9d-43b7-9ef5-7a51aa1a2644 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.440768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.441403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.441739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.442502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.444540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.450988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.452576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8fa8d7b4-024e-451d-8b5a-387f216ded99 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:49.467151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:49.468158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:41:49.469056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:49.476565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 251/495] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:49.478021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.478307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.478581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.479239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad894b7-b882-4980-b6ba-e35957d3fb8a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.499725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:49.501004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:49.518052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.518669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.518952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.519226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.519948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:49.520252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.521648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.529800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 245/496] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:49.530399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.576377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 252/497] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:49.577646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.599002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.656883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e7362-6261-4c82-b2ea-8c4b5efc6f47 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.682920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185a5ae-e27c-44a0-98c9-245ae9f1f153 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.698224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.698859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.699140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.699553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.706748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.713700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.715390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.717128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.717944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.718049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.718267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.718983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:49.719284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.720714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deb56c-fb57-4ca7-a633-68a9410cb3e1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:49.730005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:49.730912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:49.731752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:49.731752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:49.731752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:49.731752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 246/498] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:49.731994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.764915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 253/499] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:49.766163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd295-4be5-483f-9a1a-1f8302899e94 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.766460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd295-4be5-483f-9a1a-1f8302899e94 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.766736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316bd295-4be5-483f-9a1a-1f8302899e94 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.768127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 254/500] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:49.768690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd295-4be5-483f-9a1a-1f8302899e94 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.843434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07172e-cb29-41bb-b320-7942a3de3875 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.845832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:49.871876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316bd295-4be5-483f-9a1a-1f8302899e94 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:49.878516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.879153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.879435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.879710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.889771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.891229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.904725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:49.905323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.905629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:49.905818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:49.906761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:49.907632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:49.907632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:49.907632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:49.907814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.907814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:49.907814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:49.908317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 247/501] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:49.908317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:49.908438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4e899-caf6-42ad-8a0b-fc22f5047f9b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:49.927262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 255/502] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:49.927262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:49.927262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:49.927262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:49.942101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:49.943338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:49.978552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.009996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 256/503] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:50.010819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.011528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c564a-6eac-4a0a-911a-db91cb49ecc3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.057879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.058814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.058814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.059008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.086571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.121556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2aad7-8bad-4e19-aa4f-cc5b18b84ed6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.131327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.133245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.159493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.160085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.160870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.161154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.171458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:50.176822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.177692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:50.178478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 257/504] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.179130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.213566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.250366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 248/505] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:50.251324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.294386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc20ab-67b3-4830-bac8-2953d787f118 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.308019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.328308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.328910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.329187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.329457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.330092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:50.330421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.331800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.343422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 258/506] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:50.344236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.353481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e11b0-c417-4c15-9cca-08eca8de087c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.386390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.387038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.387315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.387584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.395327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.396817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:50.409128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.410035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 249/507] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.411691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.436556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.444938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48727ebb-d078-4df1-953e-d9b61a8d6358 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.481284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.481905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.482186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.482467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.483126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:50.483433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.484844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.493358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 259/508] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:50.494140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.516209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a018b19-8005-430b-be5a-4e0f56d99dd8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.531785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.550023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.550750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.551570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.551854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.562006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.563821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:50.578803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.579877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:50.581070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:50.581070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.581070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:50.581070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 250/509] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.581070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.592224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679ecbd-9e38-44b1-9851-fbabb5e2cedc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.626139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.626771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.627062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.627337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.637872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.639319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:50.652962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.653863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:50.654683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:50.654683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.654683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:50.654683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 260/510] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.654905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.666114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.680066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249abde-c048-469b-8fc5-44de3ed0f064 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.713952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.714581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.714865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.715144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.723579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.725082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:50.736132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.737089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 251/511] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.739071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.757472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd8e7a-22d6-49c3-ba13-f0c13fefeec9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.766563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.790862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.791485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.791770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.792083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.792812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:50.793122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.794578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.812913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 261/512] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:50.813723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.841322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243fe4e2-e2e0-4ed4-8c44-3d55512789e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.875193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.875810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:50.876200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.876200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.876425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.887311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.888807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:50.902863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:50.903765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:50.905261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:50.905261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:50.905261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:50.905261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 252/513] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:50.905261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.917548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b4719-6a5b-4ffd-bde0-3815cdb1b832 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:50.950283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:50.950881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:50.951160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:50.951427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:50.952094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:50.952393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:50.953772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:50.965195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 262/514] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:50.966021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:50.992058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.010092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20567d-1420-475b-b5e7-ba442ae69e4a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.044344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.044942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.045216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.045483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.046120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:51.046416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.047788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.058577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 253/515] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:51.059361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.064658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8263f-84b8-4e74-adb2-d229b3e80be2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.088164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.098792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.099391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.099673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.099969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.100691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:51.101038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.102489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.119431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 263/516] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:41:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:51.120252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.158567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f181ab-10c6-4156-a3f8-b55853602ef8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.192312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.192847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.193130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.193404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.203559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.218311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea1d1-e563-4211-a8dd-6f4d4b879944 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.253074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.253650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.253932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.254212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.254845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:51.255146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.256536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.261203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.262676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.267592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 264/517] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:51.268431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.314605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.364823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 254/518] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:51.365627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.373273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd5804-af54-4303-99c4-4b8e2cdb558f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.405408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.406734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.407364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.407642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.407929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.414365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.416086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:51.427586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:51.428441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:51.429272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 265/519] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:51.429734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.466705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b82a5-259a-4555-b5c8-bd48bd278d01 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.499851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.500485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.500771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.501052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.501695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.503158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.529248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419ef0f-3c6b-4c52-a895-31c7df9f4027 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.530764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.561357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.561961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.562242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.562513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.579333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 255/520] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:41:51 2022] POST /identity/v3/users => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:41:51.580196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.636804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.638358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.715294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.721019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ed22-88d9-403a-8d88-dc35fdd048e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.755246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 266/521] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:51.759960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.759960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:51.760157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.760157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.760157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.760157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.768052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.769629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:51.783398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:51.784650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:41:51.785662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:51.791170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 256/522] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:51.792331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.875001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6cf71-8572-4036-95b3-92c9f724abad None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.900189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6d09e-83ea-4bfc-a82b-40a8d1abd389 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:51.912815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.913565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.913850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.914130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.925051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.927250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.934354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:51.934965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:51.935246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:51.935522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:51.936240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:51.936548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:51.937974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:51.944254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:51.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:51.946053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:51.946053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:51.946053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:51.951769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 267/523] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:51.951769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.956770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 257/524] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:51.961554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:51.975211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.009079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.060563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52d367-f919-4a29-91c8-7603173ccf3e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.062086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27529e49-a537-40ae-abfd-556743e560f3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.094809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.095428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.095734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.096006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.096758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:52.097049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.099024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.101226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.102091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.102553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.103005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.114859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.116572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:52.132233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:52.133222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:52.134057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:52.134057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:52.134057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:52.140514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 268/525] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:52.140514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.142819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 258/526] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 13:41:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:52.147335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.220334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.245513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62863d0a-9447-40e3-b540-165d4a0f2710 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.247248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0832c1d-7dc6-4e48-b45d-89579baa35a3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.253313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.281042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.281787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.282077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.282402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.282994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:52.283301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.284746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.285886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.286559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.286766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.287037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.287859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:52.288194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.289615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.296006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 259/527] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:52.296789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.314719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 269/528] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:52.314719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.432020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e948d65-cf0e-4b7c-a3f6-fe27a30b844d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.438740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632bf847-4850-4d80-92f9-32cb6aa9a211 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.483230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.483857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.484166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.484442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.490637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.491274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.491562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.491842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.492580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:52.492893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.495209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.506031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.513931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 260/529] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:52.515323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.530104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.568115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.569610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.642596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707cb02-7a0e-48e6-a14a-2ed55eb73e14 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.680793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.681427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.681754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.682023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.688041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 270/530] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:41:52.692836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.693693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.695362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:52.711854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:52.712900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:52.713719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 261/531] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:52.714406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.778794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.781063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:52.824461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdabcd-622f-48e2-a70b-f0bf32018e0c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.828441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ccc9e-1da7-4640-838e-e323b6331689 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:52.862959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.863737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.864057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.864324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.876431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.877907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.878415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:52.879717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:52.880118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:52.880631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:52.889525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:52.890981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:52.893968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:52.895515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:52.896376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:52.896376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:52.896376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:52.896937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 262/532] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:52.898006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:52.907384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:52.909133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:52.911346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:52.920006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 271/533] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:52.920006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.027577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1f551-9961-4c63-a015-82821184ead3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.031693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cbf03-b4a9-4417-9a18-76bc52b37142 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.042980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.062990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.067745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.068599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.068946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.069284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.070451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.071103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.073304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.074027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.074651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.074938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.075505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.076173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.076966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.081012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.087177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 263/534] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.092609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.096333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 272/535] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.097214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.207582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b608e-e23d-4aee-8ca4-237265b9dd05 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.209203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15508cf4-1675-4f2d-b6b6-71d30f870509 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.248148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.248425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.248818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.249005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.249144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.249361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.249504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.249748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.250052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.250362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.250882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=b6621711a3aa475fad33e482bd096989) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.251248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.251797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.252820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.259634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 273/536] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/role_assignments?user.id=b6621711a3aa475fad33e482bd096989&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.264969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.265232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 264/537] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.270959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.340510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.382072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.398353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53d8d8-b628-4b3b-83e9-5008450051f9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.446400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.447050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.447400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.447677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.460814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.462292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:53.476761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:53.477603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:53.478434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:53.479477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 274/538] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:53.490379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.534797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1fac7-1444-4358-ba96-c12e85b37a03 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.620734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.621714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.622197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.622682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.623611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=983535804007417db2c2f7727e70cda7) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.624150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.625791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.631953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda42c48-12c1-4a43-a06c-bdb0a2a16eab None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.638914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 265/539] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/role_assignments?user.id=983535804007417db2c2f7727e70cda7&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:53.644353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.673822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.674461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.674989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.681121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.681121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.681121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.681121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99811fc8-48c7-4217-b7d3-d7e1bf781c28 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.700255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 275/540] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.706618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:53.815363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:53.827412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffad817-6ed5-4ead-ad24-22f595b62f46 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:53.837402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd74-b23c-401c-87f4-e6b1feb7fc2e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.837708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd74-b23c-401c-87f4-e6b1feb7fc2e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.837968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743dd74-b23c-401c-87f4-e6b1feb7fc2e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.840984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 276/541] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:41:53.845637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.845933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.846203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.868347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:53.869602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:53.895396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:53.895972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:53.896268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:53.896542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:53.897283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d222074760c44210aea4b01f334238ea) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:53.897593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:53.899039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:53.904983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 266/542] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:53 2022] GET /identity/v3/role_assignments?user.id=d222074760c44210aea4b01f334238ea&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:53.965481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 277/543] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:54.318970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:54.428167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78bb5e-3780-422f-8086-48dda18ef23b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:54.473239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:54.473917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:54.474262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:54.474546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:54.496807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:54.502225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:54.503074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:54.503836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 267/544] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:54.509245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:54.649439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:54.652924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db1a4a-d8d7-4974-b3c6-d96b13d75ddf None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:54.700767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:54.701419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:54.701705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:54.701982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:54.702673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:54.702979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:54.704419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:54.714164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 278/545] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:41:54.719738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:54.752622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:54.855840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c203f-f760-42e9-addd-6a4b36fabedd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:54.903541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:54.904130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:54.904417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:54.904693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:54.916144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:54.917619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d7b25022-38fd-4944-9a2b-79145c6cf330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:54.939334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:54.940304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:54.941217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:54.941217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:54.941217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:54.941217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 268/546] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:54.946444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:54.991192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c03be-0ea2-47f4-b8f1-bb281c93ba18 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:54.991510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c03be-0ea2-47f4-b8f1-bb281c93ba18 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:54.991755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c03be-0ea2-47f4-b8f1-bb281c93ba18 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:54.993429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 269/547] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:55.000845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.000845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.000845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:55.023838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:55.025160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:55.112251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13ee10-6cd7-451d-b2b9-e71af44339e6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:55.136301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:55.144323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 270/548] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:41:55.174192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:55.174741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.175033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.175374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:55.176079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:55.176443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:55.177935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:55.195255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 279/549] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:55.200819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:55.354755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de6611c-318f-4848-98a7-6d7e6d2d0ce9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:55.406947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:55.407590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.407868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.408162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:55.420978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:55.422447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:55.437375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:55.438267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:55.439152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 271/550] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:41:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:55.444825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:55.501305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:55.596139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:55.618604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff589067-386e-4916-a59c-506603ef0fa3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:55.684399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:55.684835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:55.685892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.686171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.686495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:55.687228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:55.690060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:55.690060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:55.722356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 280/551] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:41:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:55.729437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:55.740683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07bb08-242c-4119-aebe-987739fd7288 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:55.789915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:55.790895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.791187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.791467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:55.819532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:55.829401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:55.830381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:55.831178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:55.837906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 272/552] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:41:55.840499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:55.918705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:55.938553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753dd41-6ffd-484b-8edc-b214eccdd7a6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:55.976134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:55.976759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:55.977040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:55.977313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.002714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edc05f-532b-4a20-ae4b-efa90ddbc2fe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.030625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.049086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.051638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d95513-4b7e-486f-9dc8-1d0d391aac93 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.054316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.056213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.056842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.057328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.058280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:56.059688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.061942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f5640-0edc-4496-aa7f-d979713205b7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.079075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 273/553] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:56.079075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9f332-b7bb-446e-8d25-efac1151ab88 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.079075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9f332-b7bb-446e-8d25-efac1151ab88 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.079075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9f332-b7bb-446e-8d25-efac1151ab88 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.083995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 274/554] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:56.085277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9f332-b7bb-446e-8d25-efac1151ab88 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.153446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.182207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 281/555] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:41:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 23 13:41:56.187470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864403-9d49-41d7-a680-3a5ba84fef16 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.187470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864403-9d49-41d7-a680-3a5ba84fef16 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.187470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864403-9d49-41d7-a680-3a5ba84fef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.213362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d5864403-9d49-41d7-a680-3a5ba84fef16 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:56.218998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d5864403-9d49-41d7-a680-3a5ba84fef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:56.219808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9f332-b7bb-446e-8d25-efac1151ab88 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.258705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.258705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.258705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.258705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.268435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.270602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:56.284818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:56.286539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:56.287568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:56.287568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:56.287568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:56.291379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 275/556] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:56.292251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.295380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 282/557] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:56.296519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c3a1-1916-447a-b512-e5032b4f4f68 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.296804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c3a1-1916-447a-b512-e5032b4f4f68 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.297074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c3a1-1916-447a-b512-e5032b4f4f68 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.300888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 283/558] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:56.300888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73c3a1-1916-447a-b512-e5032b4f4f68 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.334266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.411382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949abc1-16d4-4425-930f-6d85f013b838 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.446911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.447547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.447949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.448148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.450994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73c3a1-1916-447a-b512-e5032b4f4f68 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.458638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.460169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.467455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e09d8b70-08d6-4734-ab6a-e9819135c858 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:56.482175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:56.483122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:56.484096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:56.484096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:56.484096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:56.484096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 276/559] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:56.484609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.484826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.485101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.496402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.497269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.497729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.498001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.498645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:56.498949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.500430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0aa32-bdd6-4660-a212-531513a1a9b7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.503304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:56.504559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 284/560] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605ba8-69bf-4604-92bf-840c843c63ef None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605ba8-69bf-4604-92bf-840c843c63ef None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a605ba8-69bf-4604-92bf-840c843c63ef None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 285/561] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:41:56.517773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a605ba8-69bf-4604-92bf-840c843c63ef None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.580785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 277/562] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:56.580785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.606275 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.624159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a605ba8-69bf-4604-92bf-840c843c63ef None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.659568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.660229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.660508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.661432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.661432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:56.661700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.663057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6a06-de3d-404d-9547-4deef6361ea3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.675427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 286/563] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:56.676531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.676815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.677086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.694860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:41:56.696069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:41:56.696334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50491538-a595-40fa-9f46-8e35a5c2fc37 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.720979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.731745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.738700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.738700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.738700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.740379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.741905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:56.753585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:56.755205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:41:56.756417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:56.762229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 278/564] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:56.762229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.776137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 287/565] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:41:56.777066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.842246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:56.865530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232a958-f18e-4357-92ee-499f2035a3a1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.900958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.901713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.902128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.902364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624b087-1a7d-4761-937c-56d3e4f3a943 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:56.902586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.913600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:56.919352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:56.920460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:56.921446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:56.923192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 279/566] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:56.923883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:56.945245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:56.946010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:56.946400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:56.946787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:56.954116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:56.955653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:56.967770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:56.968743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:56.969805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:56.976191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 288/567] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:56.977177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.001745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.024550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12952b61-3811-4f7f-b907-99abbd7d4d92 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.058502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.059067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.059351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.059629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.060380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.060686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.062117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.064747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.080163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 280/568] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.080982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.082296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17945d2a-0c1b-4631-ba48-9e377a9051fc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.118022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.118642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.118924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.119194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.128942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:57.134250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:57.135155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:57.136007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 289/569] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:57.136695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.177905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea8202-e996-4b26-bb69-86cc670138c8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.210237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.210832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.211109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.211377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.212069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.212371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.213732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.217585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.221568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 281/570] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.222373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.236786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b558ec-6d65-4308-a830-fb1e6be2adae None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.270546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.271145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.271423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.271693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.272407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.272716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.274136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.279608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.286322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 290/571] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.286962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.325349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6b77d-2d0f-4f8e-b72e-3d0135709b4a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.357835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.358465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.358742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.359013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.369322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:41:57.375369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:57.376473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 282/572] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:57.377444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.387602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add5199-8e6d-4718-94df-17f66926c00a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.421646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.422358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.422638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.422910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.431354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.433354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.434855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:57.449439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:57.450521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:57.451435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:57.451435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.451435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:57.455310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 291/573] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:57.456165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.480443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e38e3-d31a-4ee6-9bef-80c9d4181b16 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.496870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.513622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.514238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.514519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.514796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.515479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.515786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.517195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.525638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 283/574] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.526495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.558144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a84a90-d8da-480b-949d-2fd7397ec7c8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.589520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.590073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.590349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.590620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.601171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.602608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:57.616968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:57.618040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:57.618932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:57.618932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.618932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:57.618932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 292/575] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:57.619150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.628838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4a3b8-5ffe-4234-8eca-a3edd9d53acc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.661949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.662651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.662993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.663325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.664090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=e30835b6a01b456bb97d745ad0052a0d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.664397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.665991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.666109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.671281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 284/576] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/role_assignments?user.id=e30835b6a01b456bb97d745ad0052a0d&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.672082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.726920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.727258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b179-276f-49a8-b7b7-e1b4aaf3735a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.766209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.766954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.767300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.767638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.768421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.768789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.770809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.784261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 293/577] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.784261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.798074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f2bb65-77e1-410f-bded-976d8fe82fb0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.838524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.839136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.839414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.839756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.840361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:57.840664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.842790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.856561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 285/578] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:57.857470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:57.903084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241902f-1a07-4564-add9-3b91ef92453c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.911681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.938628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:57.939260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:57.939545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:57.939818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:57.950830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:57.952302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:57.962832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b155ab9-cead-424d-a64d-01efb6ecdab9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:57.964626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:57.966735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:57.967633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:57.968616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:57.968616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:57.968616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:57.973544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 294/579] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:57.974416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.004142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.004843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.005194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.005540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.006345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:58.006718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.008207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.021995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 286/580] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:58.022904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.081657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73962-6a4f-445b-b49e-71ef5c22a217 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.115940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.116509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.116793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.117066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.127703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.129695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.133793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d920ae-c15d-46d1-89f2-19db917671fd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:58.143703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:58.145380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:58.146323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:58.146323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:58.146323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:58.146323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 295/581] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:58.146551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.161858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.173543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.175112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.175112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.175112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.181597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.183171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:58.195551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:58.196472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:58.197339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:58.201222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 287/582] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:58.201994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.228202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.255254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b6612-4a3a-457e-9249-5dd8a871dcda None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.315738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30421952-438c-41dc-a3ca-9ee9972a7a19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.319901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.320734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.321158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.321570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.322349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:58.322795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.324458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.337782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 296/583] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:58.338891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.354284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.354921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.355201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.355472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.363083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.364624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:58.376655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:58.377758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:41:58.379402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:58.382872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 288/584] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:58.383738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.417677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.452018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd40ea8-6efc-4f9d-b29d-f4106b3885a4 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.474482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.493511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924f903-bc0c-46d1-bd91-dc404c1d60b2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.494866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.495662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.495966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.496246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.496888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:58.497199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.498587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.516492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 297/585] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:58.516492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.537412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.538039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.538321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.538594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.539294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:58.539600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.541334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.553602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 289/586] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:58.554412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.633827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea534a-5ce3-4071-b705-b60030c7217c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.657250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55d836-4e46-477e-919e-d1b835be44c9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.663750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.670172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.670809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.671092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.671371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.679356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.680833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:58.692575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:58.693502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:58.694453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 298/587] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:58.695030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.696330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.696941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.697226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.697496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.698222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:58.698527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.699960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.715912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.723693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 290/588] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:58.723693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.812400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16a7b-c310-478e-9b42-af9c345e0422 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.817381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b087eb4-71b6-427c-b428-24d706fc70b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:58.849466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.850095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.850374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.850640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.851396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:58.852146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:58.852367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:58.852643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:58.861961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.864013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.868972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=7ea62ee4cea94e3f941b4301885469ba, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:58.870520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:41:58.876602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:58.882920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 299/589] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:58.889362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:58.931340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:58.934053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 291/590] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:41:58 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:41:58.943018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.001811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4cf7-8561-4106-b340-c992fd3c5115 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.017436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.052475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.053973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.054444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.054901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.056337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.056861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.059165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.089366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bfafc-1b09-4041-9524-682c0b5b885b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.090421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 300/591] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:59.092660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.136148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.137098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.137565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.138483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.150951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.153257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:59.176247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:59.177410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:59.178462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:59.178462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.178462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:59.178462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 292/592] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:59.178462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.226147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152df2-04d2-4e91-9ee7-aec0a7d9d570 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.236729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.264519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.266210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.266665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.267167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.268053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.268504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.270282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.279667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad154b7c-8ba1-4262-9813-285f985873e3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.281466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.289826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 301/593] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:59.299937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.318217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.318990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.319523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.319680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.330525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.331949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:59.347247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:59.348441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:59.349520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:59.349520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.349520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:59.350635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 293/594] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:59.351580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.402847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c09bb-7f66-4f7d-8440-b7f054ac6d70 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.441174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.442645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.443069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.443577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.444426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.444872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.448130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.456028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4012e-7840-47db-b575-c31e45ec8243 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.461588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 302/595] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:59.462640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.493370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.498309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.499057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.499403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.504703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.513062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.514672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:41:59.533610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:59.534762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:41:59.536380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:41:59.536380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:41:59.536380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:59.537426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 294/596] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:59.538467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.550643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.588647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c6203-7bde-4e6d-b3af-67d340d28582 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.629996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.630890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.631315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.631718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.632526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.632984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.634492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.646923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 303/597] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:59.648022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.652650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437d1db-97e0-45db-9e12-06328ddefb63 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.693050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.693679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.694063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.694275 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.701457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.702930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:59.714947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:59.716116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 295/598] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:59.717157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.742171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.759606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4775b-aa8f-48b6-b7b4-5515e727c2ac None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.791675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:41:59.798105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.798962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.799383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.799791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.801360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.803212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.803398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.815646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 304/599] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:41:59.816731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.829128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05ff1d-41fc-4017-bc24-6729f1983c94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.864591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.865232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.865514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.865789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.872804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.874267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:41:59.886051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:41:59.887153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:41:59.888078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 296/600] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:41:59.888579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:41:59.941008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9314ed-b3ce-41f0-96dc-ba9daee253f6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.976738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:41:59.977451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:41:59.977800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:41:59.978081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:41:59.978854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:41:59.979259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:41:59.980964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace82ad5-d346-4bf1-bec0-7b6b049071ee None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:41:59.995406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01ae2e-5eed-493f-bf6e-d667f0c743d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:41:59.999131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 305/601] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:00.000232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d0719-9b43-409b-9981-d2fde4250199 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.000535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d0719-9b43-409b-9981-d2fde4250199 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.000801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d0719-9b43-409b-9981-d2fde4250199 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.003992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 306/602] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:00.003992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d0719-9b43-409b-9981-d2fde4250199 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.012711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.026050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.034702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.036070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.036418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.036761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.043443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.044969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:00.056497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:00.057544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:00.058624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:00.064212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 297/603] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:00.064212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.120840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d0719-9b43-409b-9981-d2fde4250199 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.158407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.159021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.159296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.159568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.160832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:00.161137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.162564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a63b22-51b7-464f-b9d6-b70bd7f2ff34 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.163338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29763b5d-ba29-4156-a900-755ef525216e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.176285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 307/604] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:00.181178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.181468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.181743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.198809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:00.200022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:00.205171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.205837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.206176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.206595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/b6621711a3aa475fad33e482bd096989/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.225538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=b6621711a3aa475fad33e482bd096989, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.227112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.260109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.267143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 308/605] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:00.267966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.287409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 298/606] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:00 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/b6621711a3aa475fad33e482bd096989/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:00.288704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.373265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.437549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc6dd0-24b0-481c-a0fa-32d89cc351d3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.492636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836b637-97d7-4d2d-a45b-fd4f57a42509 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.529175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.529978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.530172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.530443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/983535804007417db2c2f7727e70cda7/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.532663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.533647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.534877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.535353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.536342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:00.536799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.538492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.547878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=983535804007417db2c2f7727e70cda7, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.549640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.553501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 309/607] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:00.559303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.619224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.643028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 299/608] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:00 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/983535804007417db2c2f7727e70cda7/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:00.643951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:00.670510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f29e17-88b3-4080-8a43-8d46516ce765 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.716374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.717824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.718324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.718805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d222074760c44210aea4b01f334238ea/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.739200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=d222074760c44210aea4b01f334238ea, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:00.741133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:00.801384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:00.820173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7eec94-cb5b-4f33-877d-663041653024 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:00.837881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 310/609] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:00 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d222074760c44210aea4b01f334238ea/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 13:42:00.869927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:00.871054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:00.871586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:00.872079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:00.886619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:00.892251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:00.893240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:00.894094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:00.896316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 300/610] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:00.904945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.018487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db86337b-bbd5-44b0-9165-598cca6445ed None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:01.027017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:01.056673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:01.057205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.057543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.057812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.058514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:01.058872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:01.060302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:01.069543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 311/611] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:01.075121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.190731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e8d03-76be-41d5-92c0-a7e813d122db None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:01.237861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:01.239307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.239743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.240215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.255614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:01.257359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:01.265153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-cefb300c-d136-498d-9605-b74807c41279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:01.273550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:01.274454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:01.275358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:01.275358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:01.275358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:01.279340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 301/612] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:01.280922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.324381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06249b-3978-45d9-bd9b-7c1e32c4bd81 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.324630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06249b-3978-45d9-bd9b-7c1e32c4bd81 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.324954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06249b-3978-45d9-bd9b-7c1e32c4bd81 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.326685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 302/613] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:01.331885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.332241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.332521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.353272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:01.354473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:01.479283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153eb4b-d75b-47d5-90ce-3d049e5ec7a3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:01.491960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 303/614] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:42:01.530899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:01.531516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.531794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.532095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.532798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:01.533103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:01.534461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:01.551038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 312/615] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:01.556866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.690885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d7649-56de-4a1a-8a7b-3ccfb5a9e401 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:01.726980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:01.735122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:01.735759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:01.736059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:01.736329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:01.746797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:01.755508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:01.763371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:01.764326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:01.765256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 304/616] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:01.771034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.792970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:01.845183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:01.927768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572de5b-8fa7-4fc4-ba8f-4caedb759f6a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:01.998595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:01.999656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.000298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.000776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.006558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143bc82-a0d7-4f7a-949c-d8f47da9e1aa None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.015964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:02.022250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:02.023182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:02.024013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:02.027045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 305/617] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:02.033054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.089396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:02.104607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.105230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.105514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.105862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.106514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:02.106820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.108294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.142222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 313/618] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:42:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:02.148285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.169018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da2cb-d73c-4bf7-840c-69dfe9d5ce43 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.241926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.242548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.242837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.248546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.248546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:02.248546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.248546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.263370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 306/619] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:02.271020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.294235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:02.313648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209c751-39fd-4733-9de2-66ab501a30fb None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.354041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.355118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.355671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.356174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.368405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.370453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:02.387269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:02.388550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:02.389448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:02.389448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:02.389448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:02.391446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 314/620] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:02.397657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.495895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2a039-1c62-4664-bf67-0f9fc8fdf193 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.510418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:02.540649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.541686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.542342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.542873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.556792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.558591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:02.575865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:02.576849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:02.577717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:02.577717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:02.577717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:02.580061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 307/621] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:02.587449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.629880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25264269-e943-42a3-9473-0fe6626d4acd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.704004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.704619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.704898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.705168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.705805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:02.706109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.707520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.720254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:02.735265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 315/622] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:02.747628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.754231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728846dc-6b4c-4f74-b8af-cc1b424cdb6e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.813618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.814608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.820388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.820883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.821761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:02.822272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.823961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.847484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 308/623] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:02.853916 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:02.872737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e0ac8-4c32-4e9a-b09f-17a012d94c93 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:02.894688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:02.920536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:02.921186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:02.921480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:02.921750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:02.931485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:02.932959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:02.957818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:02.959331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:02.960739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 316/624] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:02.969043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.034540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.073344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8badff68-6e03-4f9f-b617-88e413dd56da None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.092192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f684b-1644-41de-ab0f-26bc038e0c8b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.112287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.112962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.113338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.113539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.121589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.123252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:03.128536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.129187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.129474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.129752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.130450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:03.130761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.132232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd427ba-35b1-4152-940c-963cfc6c33bb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-94e0f40f-4012-4edf-bb77-cebc496400d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:03.135886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:03.137127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:03.138307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 309/625] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:03.138938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623b66-acba-42ea-a02e-d3788f948de6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.138938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623b66-acba-42ea-a02e-d3788f948de6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.138938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae623b66-acba-42ea-a02e-d3788f948de6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.140478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 310/626] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:03.145880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae623b66-acba-42ea-a02e-d3788f948de6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.151471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 317/627] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:03.153099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.153554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.153979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.175023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:03.176679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:03.239619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.260020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 318/628] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:03.260912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.264620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae623b66-acba-42ea-a02e-d3788f948de6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.311949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.312836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.312962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.313251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.313975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:03.314329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.315864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aef070-e979-4f97-8ac1-4cf43ce158f4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:03.333165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.336625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 311/629] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:42:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:03.337878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cecbd-b666-4599-9749-256418654c65 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.338291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cecbd-b666-4599-9749-256418654c65 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.338567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cecbd-b666-4599-9749-256418654c65 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.339960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 312/630] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:03.343739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cecbd-b666-4599-9749-256418654c65 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.402867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78611e-7535-4b63-8dd9-ac778ec6daab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.443307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.443991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.444272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.444542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/e30835b6a01b456bb97d745ad0052a0d/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.458445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cecbd-b666-4599-9749-256418654c65 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.463514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=e30835b6a01b456bb97d745ad0052a0d, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.464996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7208d91-364c-4e1b-bcf4-fe9929c8d88b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:03.506123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.506730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.507009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.507277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.517670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.555307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 319/631] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:03 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/e30835b6a01b456bb97d745ad0052a0d/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:03.555307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff864-4f89-4fee-88cf-9a2e6f59584a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.555307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff864-4f89-4fee-88cf-9a2e6f59584a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.555307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff864-4f89-4fee-88cf-9a2e6f59584a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.575289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c79ff864-4f89-4fee-88cf-9a2e6f59584a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:03.576569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c79ff864-4f89-4fee-88cf-9a2e6f59584a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:03.579875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.581427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94c41c-ece1-499d-9476-19ad34cf2530 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:03.658805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 320/632] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:03.660129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171202bd-bfdb-4abe-8520-c2ba481993fe None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.660415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171202bd-bfdb-4abe-8520-c2ba481993fe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.660685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171202bd-bfdb-4abe-8520-c2ba481993fe None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.662124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 321/633] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:03.662635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171202bd-bfdb-4abe-8520-c2ba481993fe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.699938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.713139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 313/634] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:03.714447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.714731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.714999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.735890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:03.737145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:03.787552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:03.801767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171202bd-bfdb-4abe-8520-c2ba481993fe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.821910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 314/635] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:03.822744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.839275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.840080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.840456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.840905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.852081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:03.857271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:03.858439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:03.859471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:03.871942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 322/636] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:03.873902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:03.934016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763070d3-a49e-491e-bd4a-e645d3bbe5e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:03.969105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:03.969747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:03.970028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:03.970304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:03.983062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:03.983062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:04.004368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.005522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:04.006595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:04.006595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.006595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:04.006595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 315/637] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.012730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.027673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.040536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.042862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e0e2d-ac9a-4a20-94d0-c487c2ca0fff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.077765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.078716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.079131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.079607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.080459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.080904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.082535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.091222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 323/638] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:04.092361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.128976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad4d32-bb03-4611-a0bf-bc0f30ded6fc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.164972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.166000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.166285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.166587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.167229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.167536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.169056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.181793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 316/639] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:04.182685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.203578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667f7aa-786f-481c-8cbd-44b55c29a4a0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.240137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.240846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.241178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.241515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.252203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:04.257523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.258698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:04.259820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:04.265407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 324/640] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.265407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.269970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.278139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.288740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f21a44-8fd8-4546-a317-6c2e726e74d9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.324969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.325611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.325897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.326172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.336637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.338100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:04.353506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.354669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:04.355759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:04.355759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.355759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:04.359381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 317/641] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.360248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.375526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d5b60-63c7-4e4b-b60e-7e0be44293d6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.415033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.415957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.416244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.416517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.428384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:04.436049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.437046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:04.437878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 325/642] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.438580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.480238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b45fed-c0c0-435f-86a4-a7703269d23f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.514953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.515663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.516403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.516685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.516957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.518955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.524906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.527789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:04.538675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.539554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:04.541099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 318/643] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.541669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.549810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0fb59-7e53-46c5-a20f-98cdd08e2168 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.584445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.585063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.585339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.585609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.586262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.586561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.587949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.595954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 326/644] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:04.596679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.651149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4f6460-f905-4397-9cf7-edc62ab8abed None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.684915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.685520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.685797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.686072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.686702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.687003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.688402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.700043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 319/645] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:04.700828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.708566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bd833-473f-4fa3-bf37-22e8bb132b47 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.737193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.742513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.743130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.743408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.743784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.744522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.744851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.749803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.760388 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 327/646] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:04.760388 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.761250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.808272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be1a36d-de30-45b0-b55c-fa3eb2d111fc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.844993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.845599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.846094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.846213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.846842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:04.847115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.848551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.865073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 320/647] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:04.865073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.870098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b4916-2434-41f2-9904-4433138f0ddf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.904984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:04.905613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:04.905887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:04.906155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:04.916933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:04.918469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:04.934050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:04.934975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:04.935854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:04.935854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:04.935854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:04.935854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 328/648] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:04.937147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:04.979554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf155-ea94-4ded-8d1a-bd6c8fb24f59 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:04.985121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:04.992976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.012934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.013560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.013837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.014103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.021934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.023360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:05.034369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:05.035304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 23 13:42:05.036324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:05.040490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 321/649] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:05.041543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.045210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e2dfa-16af-4f30-9164-cdcd7a19b5b2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.081386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.082568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.082853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.083127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.096333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.098014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:05.112720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:05.113689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:05.114591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:05.114591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:05.114591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:05.118526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 329/650] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:05.119171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.158748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79c00e-07c1-4110-9283-ba9e205eddbd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.200896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.201772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.202055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.202324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.203202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:05.203809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.205341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.212256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 322/651] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:05.213047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.224333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.229801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f197375-b825-4286-9eb3-ed051ffd2d87 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.260668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.270044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.271022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.271450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.277214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.277214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:05.277214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.277214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.292205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 330/652] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:05.293292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.347504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7299eb-7463-4851-ad11-e09186b50c59 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.397535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.399053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.399515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.399970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.401226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:05.401694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.404282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.413045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa4589-3a12-4a90-9e13-e51d72ee2d05 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.429856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 323/653] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:05.430733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.459163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.460658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.460658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.461116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.461889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:05.462455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.464077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.480857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 331/654] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:05.484314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.509867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.558987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.566559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a35d-9b3d-4a4b-95aa-2aaa942053ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.615295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.615985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.616271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.616545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.620417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4215b-b513-4973-bf83-5794c4be8be8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.624221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.625684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:05.637834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:05.638796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:05.639726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 324/655] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:05.644490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.667797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.669114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.669603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.670349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.763002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.763551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1aa4a-0409-4bc3-9843-5d487f4e37fe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.764530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a61b1-a4ca-4003-861f-7774434357cf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.784503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.816076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.816076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.816076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.816076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.819776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.821265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:05.834211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:05.835438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 23 13:42:05.836626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:05.839951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 325/656] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:05.840789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.860308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:05.878585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 332/657] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:05.880039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ecce-4024-49ec-9ae6-5db03f0a8573 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.880397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ecce-4024-49ec-9ae6-5db03f0a8573 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.880735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32ecce-4024-49ec-9ae6-5db03f0a8573 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.882282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 333/658] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:05.884821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32ecce-4024-49ec-9ae6-5db03f0a8573 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:05.949220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e7b2a-5cc3-4941-a437-c321c2bc1a2a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:05.992095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:05.992717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:05.993003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:05.993575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:05.993991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:05.994294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:05.995734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.000522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32ecce-4024-49ec-9ae6-5db03f0a8573 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.017935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 326/659] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:06.017935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.026881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.046605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.047459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.048132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.048488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.049532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:06.049910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.051445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e90f1-5801-47e4-950d-8802c3b886d9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.070111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 334/660] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Sep 23 13:42:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:06.075588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.075891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.076299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.094272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.094468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:06.095553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:06.119589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f49a-0523-4150-8db4-2ac476da0be4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.155058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.155693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.155993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.156268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.167443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.171974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 335/661] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:06.171974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.172223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:06.184310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:06.185428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:06.186531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:06.186531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.186531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:06.192197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 327/662] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:06.193142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.304550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65bb22-d9b8-4be5-8542-61993ed25dda None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.312255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.335168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820467c-6a9e-40d0-911c-3fa8e8164908 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.344301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.345483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.345867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.346243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.364536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.376840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.378001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.378514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.379644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.425128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.426688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.470872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.472686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.531822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 336/663] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:06.532846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.542201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.589207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 328/664] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:06.589981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.617097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.648012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eff95d-15bb-4d1c-857f-41f9a0cec716 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.683453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.684092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.684373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.684649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.685286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:06.685580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.686944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.698885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 337/665] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:06.699676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.712345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b108ea-6a15-4740-a6f5-119d7a945522 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.748180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.748810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.749093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.749367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.760704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:06.765510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:06.766850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:06.768119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:06.769423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.771605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 329/666] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:06.772327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.807044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175cf6e-6ef1-4087-9e55-1cb648fd5dda None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.841985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.842541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.842825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.843101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.853518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.854966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.869329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:06.869576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:06.870489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:06.871362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:06.871362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.871362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:06.875546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 338/667] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:06.876272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.886133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fc1d4-2daa-4da8-9098-22d19fd99b37 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:06.927802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:06.928466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:06.928755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:06.929028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:06.939564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:06.941052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:06.956117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:06.957127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:06.957988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:06.957988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:06.957988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:06.957988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 330/668] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:06.958219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:06.985217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d83dc-8c48-432a-b09f-1631cc19162d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.005679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.023151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.023788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.024106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.024384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.031304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.032982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:07.047563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:07.048665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 339/669] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:07.049545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.075822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea800f-71ed-4372-8052-244c55b6df8a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.114504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.115020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.115307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.115577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.116281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.116583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.117953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.123496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.132785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 331/670] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.132785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.158377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdabb0-84a8-49af-9e73-724e7616fb63 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.192911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.193523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.193837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.194080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.194727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.195037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.196437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.209779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 340/671] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.214763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.235853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b68369e-f382-4219-b02c-a0676077e50d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.258364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.271387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.272030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.272310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.272584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.273463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.273766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.275132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.293337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 332/672] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.293337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.328832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e01a2-c5ba-45d4-97bd-63ed61e72960 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.353265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.366346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.366929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.367220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.367447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.368165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.368468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.369892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.381532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 341/673] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.382244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.403052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4ce78-fe0a-4f98-879b-fa36f221eeab None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.444155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.445068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.445350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.445623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.458541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.460568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:07.478536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:07.479667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:07.480610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:07.480610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:07.480610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:07.480610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 333/674] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:07.480844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.504014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.508778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef621127-18ce-413d-b4c5-bc97dff5093f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.545315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.545949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.546236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.546512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.553069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.554511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:07.565572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:07.566706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 342/675] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:07.567977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.589276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6839e5-a61c-43f6-9236-ce529ddb275f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.602961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.624527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.625375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.625855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.626417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.632912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.634364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:07.645789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:07.646863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 334/676] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:07.647942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.676192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ac868-fcab-48e2-9766-bd4cebafaecd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.709637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.710240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.710526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.710804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.711524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=b6621711a3aa475fad33e482bd096989) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.711837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.713290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378d3a4-18ca-42c5-acc8-663b259076a7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.718927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 343/677] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/role_assignments?user.id=b6621711a3aa475fad33e482bd096989&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.720090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a0b1-b2a4-40cd-a2fb-4f97ca78359c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.720379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a0b1-b2a4-40cd-a2fb-4f97ca78359c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.720655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a0b1-b2a4-40cd-a2fb-4f97ca78359c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.724439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 344/678] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:07.724439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a0b1-b2a4-40cd-a2fb-4f97ca78359c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.751256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f947c3-709a-47a3-8ba6-b5e418cda003 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.755714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.790633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.791556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.791872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.792197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.792875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.793184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.794659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.813196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 335/679] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.813196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:07.847476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:07.855225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a0b1-b2a4-40cd-a2fb-4f97ca78359c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.895414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.896006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.896521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.896861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.897565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.897877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.900141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3ad9-e713-40db-9681-6512d313263d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.916691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 345/680] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.917975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.918643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.918933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.930073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206c251f-bff0-456a-ac6d-b9e14867c4e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:07.939013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:07.940261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:07.968977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:07.969599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:07.969883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:07.970157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:07.970847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:07.971156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:07.972689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:07.984462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 336/681] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:07.985293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.014582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 346/682] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:08.015475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.035182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.104717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.115481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5c310-4b9f-46b7-b295-d38c6f95953a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.139145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a28800-c393-4ecb-8a21-4ac876ec0dd3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.161862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.163331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.164227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.164738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.175404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.177752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.178085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.178362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.178634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.178909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.179631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=983535804007417db2c2f7727e70cda7) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:08.179958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.181675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.192295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 347/683] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/role_assignments?user.id=983535804007417db2c2f7727e70cda7&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:08.193146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:08.194376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:08.195294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:08.196298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:08.203566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 337/684] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:08.206220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.340745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.348796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7eea2-9899-4799-b209-8e4884a6b822 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.367948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e739ae-6b4d-49c4-aabe-4e4796da1503 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.401876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.402757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.403189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.403607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.404519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:08.405008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.406501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.407530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.408170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.408456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.408732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.409457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d222074760c44210aea4b01f334238ea) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:08.409769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.411227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.417861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 348/685] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/role_assignments?user.id=d222074760c44210aea4b01f334238ea&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:08.418622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.432221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 338/686] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:08.437352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.458950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.575738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990d44-8552-432e-a575-0bd9326e1b85 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.581822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773099bd-b872-4e0e-95f0-5f5c4125c7e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.620418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.621206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.621490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.621767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.628150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.629349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.629637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.629910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.631207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.636549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:08.642086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:08.649079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:08.649910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 349/687] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:08.652867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.744055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.745561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.762747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:08.785495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c5513-43fe-403b-9487-a34d5e256080 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:08.827486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:08.828515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:08.829138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:08.829947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:08.831099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:08.831655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:08.833869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:08.846007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 350/688] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:08.851978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.885526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 339/689] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:08.896270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:08.973084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.043484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9134ce92-84a9-4314-b751-47090cc9e507 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.083944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0cfe5-3bed-4ff5-84ec-70df130da3e9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.102096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.103078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.103726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.104269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.104554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.122422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.123890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:09.142182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:09.143262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:09.144228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:09.144228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:09.144228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:09.146435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 351/690] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:09.152170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.157974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.158629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.158909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.159180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.174342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.184437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:09.212512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:09.213512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:09.214474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:09.214474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:09.214474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:09.214474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 340/691] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:09.219526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.278549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9b9c3-191e-4c42-9448-c5ee75fe12b8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.296956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.319528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.320316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.320703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.321114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.321922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:09.322701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.324207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.338355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 352/692] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:09.343787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.453563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202884e3-0ff1-42b3-a57d-93e3b1c29df3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.503226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.504013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.504395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.504679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.505390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:09.505700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.507188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.520300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 341/693] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:09.526513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.543497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f0a2d-1777-456f-b323-103b775828d7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.580367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.637211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.637881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.638142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.638417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.668729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.670203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.670486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a90f-9e9f-4c65-be02-dcb40ed36e7c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:09.706338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:09.707391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:09.708393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:09.711942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.711942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.711942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.711942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.716490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 353/694] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:09.722635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.724265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.724911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:09.736607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:09.739122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:09.740408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 342/695] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:09.746314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:09.854354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a45c9-c30d-49b9-bf71-4b720dcd8584 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:09.858502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.892402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:09.896530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:09.897303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:09.897592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:09.897932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:09.899524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:09.899844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:09.901472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:09.915630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 343/696] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:09.921647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.035747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcd9d8-d8f6-46bd-a291-9fb695e11e7e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.057881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e91a81-80d3-4bdd-ac2b-32755e0ea718 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.079216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:10.079847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.080163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.080439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.081180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=e30835b6a01b456bb97d745ad0052a0d) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:10.081490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:10.082999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:10.090609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 344/697] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/role_assignments?user.id=e30835b6a01b456bb97d745ad0052a0d&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:10.150416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:10.150982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.151266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.151598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.152435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:10.152752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:10.154206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cc0790-457b-4149-8aaa-d17d0e6e3a39 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:10.175176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 354/698] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:42:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:10.183859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.184140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2dac-7011-4d9a-b000-5caf0c67b65c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.184140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2dac-7011-4d9a-b000-5caf0c67b65c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.184140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb2dac-7011-4d9a-b000-5caf0c67b65c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.184806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 355/699] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:10.190597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.191213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.191698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.193918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:10.226087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:10.227853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:10.353355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 356/700] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 23 13:42:10.374746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535fab6c-20b9-4537-8980-a5121fda19b0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.414223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:10.414774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.415055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.415593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.488979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:10.490454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:10.498542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:10.594281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 345/701] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:10.600442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.628489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:10.677176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.724247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c5dfc-5ee3-4859-a9b1-d3464896e4aa None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.796099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a98ee-bda9-493e-bf79-6ec4293ec5fc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.798512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:10.799236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.799533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.799805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.808228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:10.825043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:10.826524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:10.833976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:10.834625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:10.834907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:10.835186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:10.846290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:10.847818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:10.857633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:10.858687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:10.859565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:10.859565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:10.859565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:10.859565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 357/702] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:10.863646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:10.864600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:10.866051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:10.866051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:10.866051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:10.866268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.866352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 346/703] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:10.873398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:10.984623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d264b1-e8f6-467d-9a28-554c2000f706 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:10.992476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.021501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df9547-976b-442d-ae45-ba6987bb8950 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.037045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.038238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.039268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.039739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.041153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:11.041622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.043979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8dd40-948b-43d6-9c37-feab7eb68eb6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.060279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 347/704] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:11.061848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d015ca-393f-4cbb-89bb-e5da12f35a5a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.062257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d015ca-393f-4cbb-89bb-e5da12f35a5a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.062648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d015ca-393f-4cbb-89bb-e5da12f35a5a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.067954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 348/705] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:11.067954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d015ca-393f-4cbb-89bb-e5da12f35a5a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.072328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.073138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.073599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.074024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.074878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:11.075346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.077485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b8a87-bb88-4747-ae8e-5738628f562d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.088830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.095455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 358/706] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:11.097627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.098073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.099676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.122486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:11.124075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:11.178992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d015ca-393f-4cbb-89bb-e5da12f35a5a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.211942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 359/707] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:11.211942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.225895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.226585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.226865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.227136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.227800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.229264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458fa971-dd0c-4046-941c-0916b98d8759 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.277087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.320362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 349/708] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:42:11 2022] POST /identity/v3/users => generated 254 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:11.321901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087176-1390-48f2-b3d0-76127b0f019a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.322196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087176-1390-48f2-b3d0-76127b0f019a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.322302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13732aa0-fd23-476e-b529-1c84c3de83e3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.322480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087176-1390-48f2-b3d0-76127b0f019a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.324067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 350/709] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:11.334279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.334606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.334842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.371359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.372119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.372406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.372680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.381605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.383149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.393109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:11.394383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:11.396077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:11.396914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:11.397813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:11.403748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 360/710] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:11.405859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.541415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a9a59-3c0b-4baa-84e4-4616b58f3776 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.546029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 351/711] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:11.547138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.552136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.575424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.589067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.589699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.589986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.590265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.590967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:11.591278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.592760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.607139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 361/712] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:11.613897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.676926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04650764-b5e3-4c10-bb93-396ca5d7fb61 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.724579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.726149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.726921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.727421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.728983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.731167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.734499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5435e-ac8e-4589-91e7-c8888ecefdea None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:11.746644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:11.747679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:11.748598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:11.750235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 352/713] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:11.756703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.791389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.792467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.794178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.794702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.795687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:11.797057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.798695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.811874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 362/714] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:11.860413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:11.893044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:11.909623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756f4f5-bbbd-4310-a0b7-9022f5900025 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:11.962297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:11.962933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:11.963215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:11.963487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:11.964173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:11.964481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:11.965905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:11.976298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 353/715] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:11.983560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:12.007219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:12.068617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d48899-1245-4c4a-b5c7-27f711d686c1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:12.107371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:12.108033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.108319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.108591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] PATH_INFO: `/v3/services/network` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.109172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:12.110540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:12.123559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:12.124585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:12.125394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 363/716] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:12.133467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:12.189854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e75361-ac85-469e-9d7d-94b83e21663c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:12.249239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:12.259615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:12.259941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470fa47-9c0d-487a-8977-53f1c92072f1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:12.260512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.260885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.261252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.262082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:12.262499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:12.264142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:12.276216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:12.278889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 354/717] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:12.300743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:12.301780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.302214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.302695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.303506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] RBAC: Adding query filter params (name=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:12.303998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:12.305528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8c96f-4636-4120-af55-39f02a69d48d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:12.311061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 364/718] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:12.317070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:12.480365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ede7a-0bcd-49c3-9c39-ca05dcd3b6ca None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:12.535898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:12.536539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.536817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.537086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.537714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] RBAC: Adding query filter params (type=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:12.538016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:12.539458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2b426-f6f1-4dae-b13f-166dee54626a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:12.548094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 355/719] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:12.916051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b2fa-d66e-4738-9db6-d0ee12e8bc2e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.916562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b2fa-d66e-4738-9db6-d0ee12e8bc2e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.916640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9b2fa-d66e-4738-9db6-d0ee12e8bc2e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.918218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 365/720] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:12.923432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:12.923722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:12.924023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:12.952947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:12.954140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:13.022050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:13.033119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 356/721] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:13.382796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9b2fa-d66e-4738-9db6-d0ee12e8bc2e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:13.521166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9b2fa-d66e-4738-9db6-d0ee12e8bc2e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:13.564716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:13.565762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:13.566807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:13.567284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:13.584708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:13.589926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:13.590879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:13.591711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:13.594389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 366/722] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:13.600444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:13.714105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7e39-ecea-4db9-83c2-4819be25fc79 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:13.763562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:13.764619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:13.765149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:13.765635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:13.766501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:13.767019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:13.768645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:13.782109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 357/723] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:13.788925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:13.837173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:13.910824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da41ce-ea72-4b7d-b417-9c9fc5751065 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:13.945312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:13.946047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:13.946322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:13.946595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:13.957350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:13.958852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:13.973574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:13.974500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:13.975452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:13.975452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:13.975452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:13.975452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 367/724] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:13.980443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.069566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:14.125490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9303c-500d-4e6d-a969-2836c1b8f227 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:14.178037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:14.178662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.178944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.179221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.179869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:14.180197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:14.181574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aefce8-16f2-4897-8bdc-d9d33efab0a1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:14.205387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 358/725] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:14.210727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.227448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22199-b588-475b-b419-3ddd8038d44b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.227448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22199-b588-475b-b419-3ddd8038d44b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.227448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c22199-b588-475b-b419-3ddd8038d44b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.227448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 359/726] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:14.231377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f443c8-2395-4685-9874-4dba6448e744 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.231660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f443c8-2395-4685-9874-4dba6448e744 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.231945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f443c8-2395-4685-9874-4dba6448e744 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.233374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 360/727] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:14.234458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9030ecf-424d-432a-aa3a-68bbf20c2787 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.234660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9030ecf-424d-432a-aa3a-68bbf20c2787 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.234931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9030ecf-424d-432a-aa3a-68bbf20c2787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.255046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c9030ecf-424d-432a-aa3a-68bbf20c2787 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:14.258906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9030ecf-424d-432a-aa3a-68bbf20c2787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:14.322608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:14.336521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd88f5a-973b-44b8-a73d-b06ff6d392ec None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:14.347999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 361/728] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:14.349573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.350043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.352260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.384189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:14.386909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:14.403394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:14.404292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.404725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.405167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.419698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:14.421370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:14.443174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:14.444397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:14.445546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:14.451268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 368/729] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:14.458955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.478202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:14.525922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 362/730] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:14.623676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3bb7c-9162-4e87-96b9-74a03ac01bd3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:14.660983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.689895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:14.691762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.692446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.694267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.695223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:14.696930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:14.698574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:14.733562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 369/731] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:42:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:14.739827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.762160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:14.856401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da824376-923d-400d-ad6c-cd9c55322088 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:14.877161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044c7ab-02da-4cd0-a381-72a2f815f84b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:14.919308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:14.919973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.920257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.920530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.929595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:14.930462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:14.930940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:14.931412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:14.932469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:14.937488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:14.938418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:14.939245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 363/732] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:14.939953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:14.973476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.006426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.008528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.016844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.052799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d904a33-da4b-4895-acb7-3cc403592af2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.096119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.096789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.097070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.097897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.110534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:15.116994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:15.117894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:15.118720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 364/733] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:15.119398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.129076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 370/734] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 23 13:42:15.130709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.236599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.246111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d83f37-d244-4aba-8414-02555f1e9848 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.271669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d0698-4ed8-4839-bee5-e1557f7dafd3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.282115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.284251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.285537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.285956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.286431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.287301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:15.287721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.289252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.299116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 365/735] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:15.300116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.322662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.323566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.324086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.324513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.325361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:15.326913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.329476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.343636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 371/736] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:15.347093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.411857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe585022-d914-4ed2-983a-0260ef43a697 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.447570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.448231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.448511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.448781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.452842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b60fe3-5442-4293-9aaa-284b6cbf24fa None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.460307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.461771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e8343aa9-2673-47d5-8010-927bec3ad3e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:15.476371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:15.477394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:15.478284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:15.478284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.478284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:15.478284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 366/737] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:15.478764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe296c-cfe9-44d9-a91c-5b0fa6bcb44a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.479045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe296c-cfe9-44d9-a91c-5b0fa6bcb44a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.479314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe296c-cfe9-44d9-a91c-5b0fa6bcb44a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.480535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 367/738] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:15.481221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe296c-cfe9-44d9-a91c-5b0fa6bcb44a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.489933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.491480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.492149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.492435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.492710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.503045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.505063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b54d14c1-27df-4850-965c-a9d90aa65da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:15.519738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:15.520695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:15.521576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:15.521576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.521576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:15.521576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 372/739] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:15.522124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a1ec-5a2b-4a33-8722-0d522971f9b5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.522368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a1ec-5a2b-4a33-8722-0d522971f9b5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.522950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16a1ec-5a2b-4a33-8722-0d522971f9b5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.523986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 373/740] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:15.524649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a1ec-5a2b-4a33-8722-0d522971f9b5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.546664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.585076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe296c-cfe9-44d9-a91c-5b0fa6bcb44a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.618116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.618747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.619026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.619299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.627416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16a1ec-5a2b-4a33-8722-0d522971f9b5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.629780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.631236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d1e2082e-6dd2-476a-adf9-c842fb090fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:15.645234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:15.646303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:15.647179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:15.647179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:15.647179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:15.647179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 368/741] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:15.647707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be407c-9858-4481-b3fa-fd286a94ec8d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.647707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be407c-9858-4481-b3fa-fd286a94ec8d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.648026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be407c-9858-4481-b3fa-fd286a94ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.663833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.664470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.664749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.665021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.665921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:15.666028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2be407c-9858-4481-b3fa-fd286a94ec8d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:15.666445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.667121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2be407c-9858-4481-b3fa-fd286a94ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:15.667561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.680522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 374/742] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:15.681161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.721083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.734954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 369/743] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:15.736398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.736691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.736964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.756076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:15.757276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:15.766132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.786332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c70230-8183-4474-9b67-44cc28f9e787 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.822637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.823243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.823524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.823796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.824462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:15.824766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.826128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:15.832218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 370/744] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 23 13:42:15.832218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.851434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 375/745] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:15.851434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:15.950964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9cdea-911a-4519-b1cd-73054e74ccf8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.969022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:15.971734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f98b8-9196-4b20-97a3-a48359008c47 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:15.986952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:15.987653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:15.988063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:15.988410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:15.989125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:15.989636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:15.991183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.007974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 371/746] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:16.007974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.017978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.018749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.019574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.019856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.027130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.028612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.032628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:16.048216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:16.049199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 376/747] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:16.050070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.115426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230b10e-7629-46c5-9dfc-5e17e8709a64 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.147373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.147806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930f3cc-2e50-472e-876c-3e9963147d60 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.148029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.148314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.148588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.155792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.157274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:16.169023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:16.170021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 372/748] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:16.170959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.186387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.186994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.187275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.187546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.188221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.189586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.209288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.266461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756419d-6228-478f-a233-e1e1213eec33 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.287583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 377/749] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:16 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:16.291125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.308347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.309152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.309517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.310341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.319850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.321505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:16.334978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:16.341142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 373/750] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:16.342163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.371175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.421888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636efdc7-e319-47f5-8a89-fe6b1693fa55 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.447774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.455448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7431b0-c1f1-4ecc-8fc9-9421183ed2c7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.458355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.458979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.459256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.459529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.460260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:16.460566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.463737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.478820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 378/751] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:16.479797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.496808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818a11-b67d-431d-9044-97724489814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.497478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818a11-b67d-431d-9044-97724489814e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.497764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818a11-b67d-431d-9044-97724489814e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.498038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43818a11-b67d-431d-9044-97724489814e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.498809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43818a11-b67d-431d-9044-97724489814e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.501206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43818a11-b67d-431d-9044-97724489814e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.568365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 374/752] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:16 2022] POST /identity/v3/services => generated 240 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:16.569129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818a11-b67d-431d-9044-97724489814e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.590831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928475e-c7ba-4a93-a7ad-fa964fea2013 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.621028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.654643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.655686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.656192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.656648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.657574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:16.658090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.661453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.692083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 379/753] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:16.693224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.693933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43818a11-b67d-431d-9044-97724489814e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.745096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.746139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.746622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.747169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.748205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:16.748584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.750276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.774081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 375/754] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:16.774081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.787605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.818657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55de2a0-9d86-4b45-8420-b9470c0ba4c2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.865511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.866532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.867245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.867669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.868568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=e30835b6a01b456bb97d745ad0052a0d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:16.869045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.871336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.880348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 380/755] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/role_assignments?user.id=e30835b6a01b456bb97d745ad0052a0d&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:16.881456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:16.882066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668ef2-d54e-4cca-8bb6-ea16fd4139fe None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:16.920226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:16.920933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:16.921141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:16.921416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:16.931932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:16.933456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:16.935113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:16.970662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:16.971772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:16.973160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:16.973160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:16.973160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:16.973160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 376/756] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:16.978215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.070522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32dbd1-9854-4dab-a8bb-639444b7d4cc None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.107065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:17.141110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.141797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.142084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.142361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.178632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664828cd-54f6-46e0-9493-9b996a76db61 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.254255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.255262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.255735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.256225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.257055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:17.257516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.261520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.283134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.285009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.294950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 377/757] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:17.296982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.360379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:17.448706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 381/758] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:17.454482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.501241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3e431-747a-423f-a0a0-b74ab1473a85 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.547618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:17.562648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb68cf-0b82-461a-9113-51a675c0c861 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.577560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.578351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.578464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.578744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.597620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.599122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.601005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.601947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.602429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.602930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.612199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:17.618462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.619875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:17.625511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:17.626382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:17.627245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:17.631281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 378/759] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:17.635700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:17.636649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:17.638393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:17.638393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:17.638393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:17.638775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.638918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 382/760] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:17.642547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.748967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d13226-c2f4-4b51-986c-0866ab32e9a5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.791128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.791784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.792098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.794934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.795599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:17.796026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.797395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.827141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb10179-61a9-4f3f-816f-73b9ea0c03b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:17.899357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:17.899908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:17.900213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:17.900485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:17.901196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:17.901501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:17.902967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:17.931081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 379/761] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:17.932446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.949855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 383/762] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:17.955286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:17.980768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:18.008455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:18.064759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f58be-f3d5-443d-a075-c53591b5f07b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:18.073974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e3d2b-d123-4340-a932-2ae7d7b547c6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:18.105523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:18.105523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.105523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.105523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.112909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:18.114458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:18.126570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:18.127634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:18.128785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:18.130437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 384/763] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:18.135964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:18.152702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:18.153602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.154033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.154473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.156620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=7ea62ee4cea94e3f941b4301885469ba, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:18.158237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:18.242687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330a69c-1e0b-4cb1-8a39-ff87dcfc213c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:18.251372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 380/764] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:17 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:18.254568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:18.282244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:18.282864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.283141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.283464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.284247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:18.284663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:18.286654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffa4a6-51ee-4a59-8d30-6eeb7955ad82 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:18.300860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 385/765] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:18.307191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:18.476650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6043b2-49a3-4bd1-8dcd-5552999c7f03 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:18.484293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:18.515738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:18.516388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.516667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.516940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.517674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d0350bfa0d3f4b83921843e91cff8efb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:18.517982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:18.520054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d393e-29a9-4b13-bc61-532ef00968d2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:18.526183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 381/766] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:18 2022] GET /identity/v3/role_assignments?user.id=d0350bfa0d3f4b83921843e91cff8efb&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:18.874969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f82e2-1ac4-4add-aa86-e838ccff690d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.875680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f82e2-1ac4-4add-aa86-e838ccff690d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.876208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f82e2-1ac4-4add-aa86-e838ccff690d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.877977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 386/767] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:18.884097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9240d6-ba6e-414e-b8c6-b64f9f8eead6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:18.884981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9240d6-ba6e-414e-b8c6-b64f9f8eead6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:18.885496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9240d6-ba6e-414e-b8c6-b64f9f8eead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:18.908266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6e9240d6-ba6e-414e-b8c6-b64f9f8eead6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:18.910409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e9240d6-ba6e-414e-b8c6-b64f9f8eead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:19.004418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 382/768] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:19.177267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf0d-1601-41ca-91be-6d18c9251e1f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.178225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf0d-1601-41ca-91be-6d18c9251e1f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.178725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6cf0d-1601-41ca-91be-6d18c9251e1f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.180486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 387/769] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:19.191715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5517-c30c-4da7-a98c-0f5249447d66 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.192272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5517-c30c-4da7-a98c-0f5249447d66 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.192744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f5517-c30c-4da7-a98c-0f5249447d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.213743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-745f5517-c30c-4da7-a98c-0f5249447d66 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:19.215345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-745f5517-c30c-4da7-a98c-0f5249447d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:19.306580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 383/770] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:19.359866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6cf0d-1601-41ca-91be-6d18c9251e1f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:19.433385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69c16-3160-43f7-98fd-7e1619591918 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.433690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69c16-3160-43f7-98fd-7e1619591918 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.433863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69c16-3160-43f7-98fd-7e1619591918 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.435457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 384/771] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:19.444322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.444608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.444889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.477645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:19.478849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:19.514831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6cf0d-1601-41ca-91be-6d18c9251e1f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:19.525525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:19.579527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:19.580221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.580503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.580773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.581369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:19.582830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:19.599010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:19.600077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:19.600901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.607990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 385/772] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:19.608887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:19.611340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 388/773] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:19.625077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:19.664322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:19.734599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d90521-91b1-4906-a957-9bc5d819c5f1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:19.773642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:19.774651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.775196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.775778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] PATH_INFO: `/v3/services/network` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.776588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:19.778247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:19.788309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:19.789272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:19.790101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:19.792984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 389/774] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:19.799188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:19.832384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8761e9-727f-42e3-ab12-ad108e81c544 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:19.929291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:19.929963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.930190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.930464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.931023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:19.931131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:19.931380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:19.935889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e335233-41b4-4ffe-b38e-bc65fc50226d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:19.937970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:19.952279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 386/775] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:19.957518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:19.988971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:19.989469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:19.989802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:19.990073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:19.990705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] RBAC: Adding query filter params (name=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:19.991004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:19.991666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:19.992450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:19.998180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 390/776] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:19.999175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.077051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03604f13-c252-4d11-aa03-e131a9d3fb24 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.113812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.114422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.114728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.115117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.115751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.116398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.118021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.119243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7337cf3-2ac1-4158-b3d6-3841240d0772 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.124395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 387/777] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.125271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.157498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.158896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.159368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.160391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.173846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:20.181643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:20.182988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:20.183895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:20.186447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 391/778] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:20.187426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.215698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.238955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.254090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6b918-6782-4b09-9658-386e8f4919c0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.291687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.292647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.293074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.293589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.294467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] RBAC: Adding query filter params (type=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.294915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.296547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.306720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de2b80-cb76-4d11-856d-13bfdf83e49f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.307079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 388/779] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.308136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.342592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.343322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.343671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.344034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.344796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] RBAC: Adding query filter params (interface=public, service_id=4dd0d526c0f642dabc00730712181e02, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.345172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.347110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.355525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 392/780] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/endpoints?service_id=4dd0d526c0f642dabc00730712181e02&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.356713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.418346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a226442-b1f9-48e3-bb68-33428042a68c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.454898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.456005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.457028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.457535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.458963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.459523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.461140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.465612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.478930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 389/781] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.480137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.483337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b9864-e9c7-4f1c-b5aa-9be5ab14e387 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.496297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.523141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.523677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.523980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.524263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.524964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] RBAC: Adding query filter params (interface=public, service_id=606f7e97359d41369a79e7d52738268a, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.525275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.526833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.537461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 393/782] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/endpoints?service_id=606f7e97359d41369a79e7d52738268a&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.537461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.597410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fbfba-4c1e-4185-b2af-483407bfc116 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.643650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.644956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.645493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.645825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.646442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.648505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.654115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a0f19-948c-4810-bec2-60e2275a17b9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.655474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 390/783] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.656661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.699307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.700422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.700932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.701459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.715083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.717710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:20.735084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:20.736107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:20.736990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:20.736990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:20.736990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:20.737791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 394/784] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:20.745006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:20.748631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.785944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:20.841859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51366-202c-470e-b134-366a2f0f9c9d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.910523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.911533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.912112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.912589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.913504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.915188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15fd20-0ed8-411e-abe5-826485ede865 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.921984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 391/785] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.931964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c0658b-9ea1-4ca0-9227-b42c82748bb6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:20.968326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:20.968781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1bf3-6a5c-4b4e-a3bc-aec922f137a2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.969216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.969216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.969464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.969972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1bf3-6a5c-4b4e-a3bc-aec922f137a2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.970160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:20.970417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:20.970818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d1bf3-6a5c-4b4e-a3bc-aec922f137a2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.971801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:20.972673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 392/786] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:20.980175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a437a-a1c9-442b-84c7-453aa21d1383 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:20.980785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a437a-a1c9-442b-84c7-453aa21d1383 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:20.981278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a437a-a1c9-442b-84c7-453aa21d1383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:20.986005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 395/787] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:20.991445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.012786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1f7a437a-a1c9-442b-84c7-453aa21d1383 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:21.014599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f7a437a-a1c9-442b-84c7-453aa21d1383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:21.062136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:21.105669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f55255a-315f-4b91-b299-33aafe679cf0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.143272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.143955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.144241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.144504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.146541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 393/788] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:21.149097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47a00-46c3-4515-a3c5-dc4244333344 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.149594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47a00-46c3-4515-a3c5-dc4244333344 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.150083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a47a00-46c3-4515-a3c5-dc4244333344 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.151537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 394/789] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:21.156995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.157278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.157553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.157939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:21.159653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:21.174738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:21.176315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:21.177598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 396/790] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:21.182155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.182982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:21.184374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:21.255647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:21.261727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 395/791] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:21.303428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f34f6-ff02-4596-977a-4af58a239db2 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.326884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:21.338741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.339357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.339638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.339910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.340654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:21.340960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:21.342382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:21.364267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 397/792] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:21.367633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.578085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e84ad-e323-49e3-9faf-3c1b762d07c2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.592479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.658620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.659841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.660524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.661172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.676426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:21.678225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:21.699886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:21.700902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:21.701815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:21.701815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:21.701815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:21.712104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 396/793] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:21.713729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.718524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0408-a8d2-4c06-b4ea-87d11ac4aa61 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.754711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.755346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.755680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.755968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.766681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:21.771635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:21.772601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:21.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 398/794] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:21.774122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.801255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:21.822618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:21.885073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d79e3-ded6-42db-aedc-ebbe47064b27 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.886475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b4f7b-6423-41fe-9b7a-caf1f7cbf6d3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:21.924401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.925920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.926418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.926882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.927713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:21.928232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:21.929804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:21.944063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:21.944604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 399/795] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:21.944712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:21.944978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:21.945253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:21.946130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:21.982347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:21.991839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:21.992773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:21.993581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:22.011354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 397/796] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:22.012665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.114372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.117350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207f526-fcb8-4b89-99cc-853b6ccb99d3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.156871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.158065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.158565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.159044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.159955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:22.160841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.162800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.176591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07651b4-5389-4faf-a427-baa61af99545 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.176778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 400/797] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:22.177266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.192833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.214522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.215447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.215975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.216441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.223645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.225494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:22.237475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:22.238650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:22.239571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:22.242052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 398/798] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:22.243125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.296204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7379f7-e206-49ec-a847-65ccbfd74bc3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.337233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.337850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.338132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.338408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.339073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:22.339381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.340818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.354122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 401/799] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:22.354995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.373528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47578a-7beb-49b6-9bbd-d8105490c63a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.382256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.423196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.424447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.424921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.425878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.439467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.442146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:22.460536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:22.461504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:22.462382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:22.462382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:22.462382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:22.465226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 399/800] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:22.466163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.471619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9598f-6dc4-441a-ad96-3ca4fd54bd45 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.502488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.514238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.515228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.521067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.521506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.522378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:22.523499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.526066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.543682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 402/801] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:22.544694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.589968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fabe81-1876-41b8-8616-1424380462c8 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.625699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.626433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.626817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.627189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.638113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.639696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:22.654927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:22.656093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:22.657156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:22.657156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:22.657156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:22.657974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.663539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 400/802] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:22.664575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.682455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de4379-2d8d-4fd2-8c16-e72f38f39598 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.728876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.729486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.729764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.730032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.730672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:22.730972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.732362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.748515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 403/803] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:22.749204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.757643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:22.788551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b60e-4046-43ce-bf33-92d24cb074dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.836605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.837272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.837553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.837827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/e30835b6a01b456bb97d745ad0052a0d/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.840179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=e30835b6a01b456bb97d745ad0052a0d, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.841671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.866775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516ee14-299b-4d71-8a53-de23bfb7c952 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:22.897235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 401/804] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:22 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/e30835b6a01b456bb97d745ad0052a0d/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:22.898506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.914369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:22.916411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:22.917353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:22.918206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:22.920576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:22.921141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:22.925125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:22.956662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 404/805] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:22.962742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:22.966855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.084707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038eee8-68cc-4236-bbf7-d8b18c013679 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.125182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.125850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.126131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.126402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.135589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.137285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:23.151529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:23.152553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:23.153470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 405/806] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:23.159289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.233257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.275854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682da466-6d23-40cf-9d15-b274b2335f09 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.276606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea900ca3-af0f-4d46-9385-689a3f9cfcc5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.318648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.319763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.320372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.320498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.320743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.321014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.321361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.321758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:23.322033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.322132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.323493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bbee6-522e-459b-aa05-ac1e92abafbc None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.325709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.332002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.338045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.344316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 406/807] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:23.345642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4635446-4202-4d53-b200-40cfe323217d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.345934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4635446-4202-4d53-b200-40cfe323217d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.346210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4635446-4202-4d53-b200-40cfe323217d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:23.346720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:23.348219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:23.349218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:23.355808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 402/808] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:42:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:23.355952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 407/809] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:23.355952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4635446-4202-4d53-b200-40cfe323217d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.357133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.469023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4635446-4202-4d53-b200-40cfe323217d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.473617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658fe71-4b0c-4e0f-bd15-4be346689793 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.495013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.506204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.509709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.509709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.509709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.509960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.509960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.510141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.510283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.511035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:23.511338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.512819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e86dfd-fdfb-455a-9b67-c6047d7b5f3c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.518082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.520065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.535962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 403/810] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:23.535962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.535962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.535962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-61865174-ccc1-404e-9981-594d724c2a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:23.536346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:23.537245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:23.538368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:23.538368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:23.538368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:23.538368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 408/811] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:23.538646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f01c-2623-4580-8699-dfa918a8e8af None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.539131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f01c-2623-4580-8699-dfa918a8e8af None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.539234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459f01c-2623-4580-8699-dfa918a8e8af None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.544886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 409/812] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:23.545717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f01c-2623-4580-8699-dfa918a8e8af None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.553107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:23.554300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:23.604878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.631636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 404/813] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:23.631636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.672766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459f01c-2623-4580-8699-dfa918a8e8af None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.713176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.713810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.714090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.714358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.741098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921612c7-2550-4844-8ca9-e89b7bfe4d53 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:23.777590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.777762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:23.778188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.778523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.779139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.779813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:23.780147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.781521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2e860-264d-41a5-a89d-860744306958 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.798665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 405/814] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:23.799987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:23.800905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:23.802881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:23.810835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:23.812621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:23.819711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:23.820947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:23.872767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:23.899800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 406/815] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:23.901203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:23.933571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 410/816] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:23.934689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.013973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a7115-6371-48a0-bec1-ed6af0aef481 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.029246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.052953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.053661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.054003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.054336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.056414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fe92d-07b6-494a-9a2e-9ad33b49a0a5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.062310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.063829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:24.075876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:24.076788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:24.077654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 407/817] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:24.078126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.095781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.096760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.097823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.098349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.099278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.100885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:24.113000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:24.113955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 23 13:42:24.114795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.116368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.118820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 411/818] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Sep 23 13:42:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:24.119934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.185643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057f258-1c62-4e10-8e35-3470f86cda48 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.224317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.225094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.225372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.225643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.237012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.238639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.239245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b558ce-76f3-44bd-984f-5aa6fa840554 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:24.254570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:24.255536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:24.256458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:24.256458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:24.256458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:24.256458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 408/819] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:24.256458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.279595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.280161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.280438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.280707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.281641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:24.281949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.283449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.292031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.296868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 412/820] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:24.297522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.354342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.368752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b44f8d3-ce7d-46fa-a513-74e0578f0a7b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.403673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.404327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.404620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.404878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.404977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b0e7f-6ef1-4f49-aad4-2fdd7a45e7ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.405505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:24.405807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.407175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.411690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 409/821] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:24.417339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.441128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.442084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.442362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.442662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.443207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.444586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:24.453500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:24.454452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:24.455295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 413/822] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:24.456108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.523144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.526850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaddc0-e8fc-4692-bc50-3054f893f5b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.561548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.562085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.562378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.562635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.563044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051ea83-fe78-4b51-b05b-e2cab518cae0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.563269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:24.563593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.564967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.576981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 410/823] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:24.577666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.591520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.605659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.606327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.606600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.606873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d0350bfa0d3f4b83921843e91cff8efb/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.621745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=d0350bfa0d3f4b83921843e91cff8efb, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.623196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.679958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 414/824] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:24 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d0350bfa0d3f4b83921843e91cff8efb/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:42:24.679958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.690744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95672040-77c0-4723-bbe5-b59d2dd3a2d6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.729636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.730302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.730583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.730851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.731481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:24.731779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.733183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.739417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 411/825] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:24.740386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.817415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5032f37-b509-4db5-9dba-435499e46df8 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.831567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.836142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:24.860716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5d9f-2262-4691-a2cc-3f5e79f43dab None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:24.863355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.864882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.865170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.865449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.867352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:24.867680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.869227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.875644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 415/826] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:24.876294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.906425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:24.907419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:24.907977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:24.908454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:24.916676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:24.918173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:24.933660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:24.934576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:24.935436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 412/827] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:24.936386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:24.997771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ea4c2-a5a7-4685-b7ce-d466e562a8a6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:25.037894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:25.038607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.038894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.039260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.039945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:25.041661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:25.045445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12c680-c964-460c-aa25-ac5b6cec8d5f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:25.083858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:25.084497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.084781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.085052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.085831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:25.086296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:25.087646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:25.089160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:25.098569 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 413/828] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:25.098569 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:25.141890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 416/829] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:25.141890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:25.212957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:25.269983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f949449-638c-4fde-bf70-25da995dcbb2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:25.310529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dda84-94ef-4b23-acf0-f3a9de5846c6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:25.312278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:25.313149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.313496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.313829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.314596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:25.314963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:25.316681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafd76c-1e32-42b1-84fc-34c1aa060ed4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:25.330915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 414/830] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:25.333626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27762-cc3f-4fc0-8658-fb20332c51e0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.333626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27762-cc3f-4fc0-8658-fb20332c51e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.333626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d27762-cc3f-4fc0-8658-fb20332c51e0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.334442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 415/831] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:25.337101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d27762-cc3f-4fc0-8658-fb20332c51e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:25.358283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:25.359156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.359537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.359905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.362031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:25.363752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0ca97-8d6b-4200-882a-39c84b2e7ad2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:25.411257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:25.428340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 417/832] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:25 2022] POST /identity/v3/endpoints => generated 337 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:25.430792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.431270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.431693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.457376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:25.463631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:25.479966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d27762-cc3f-4fc0-8658-fb20332c51e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:25.522532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:25.523456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:25.523886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:25.524330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:25.525367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:25.525833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:25.527574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:25.535725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 416/833] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:25 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:25.601911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 418/834] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:25.881171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:25.988889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1f395-33d3-4e94-8544-0b3e608f0009 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.007949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:26.026507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.027378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.034325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.034325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.039543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:26.044745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:26.045641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:26.046463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 417/835] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:26.052120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:26.067789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:26.161477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e503acbe-36ef-4094-8431-0201bde7903b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.198661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.199321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.199600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.199864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.200581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:26.200880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:26.202240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:26.210855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 419/836] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:26.216299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:26.324861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb079a8-c08c-4fcc-a88b-fd73b8c93980 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.358604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.359237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.359513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.359785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.371049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:26.372498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:26.387204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:26.388160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:26.389034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:26.389034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:26.389034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:26.389034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 418/837] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:26.397040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:26.495023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:26.520711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb22fb1-c22c-480f-ac00-26c25c6f892b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.559676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.560665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.561142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.561639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.562467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:26.562965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:26.564565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:26.577071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 420/838] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:26.587942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:26.615587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:26.694184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c1b37-ee4a-491a-8707-bdd771013d12 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.728992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.729626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.729904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.730174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.737452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:26.739483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:26.751047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:26.752013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:26.752946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 419/839] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:26.757990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:26.860636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f954e39-76b2-4750-9254-23bb59593116 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:26.895322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:26.896313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:26.896950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:26.897420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:26.898338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:26.898858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:26.900508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e39ac1-b5d7-49e3-a87b-a1e761d817f5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:26.903448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:26.920091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 421/840] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:26.926670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.026521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.036909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2148be-79b5-47c4-b50d-a968ed7ec853 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.078583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.079190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.079469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.079740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.129510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fba09-42d9-433d-aa32-6b88a2e392eb None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.129880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fba09-42d9-433d-aa32-6b88a2e392eb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.130074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fba09-42d9-433d-aa32-6b88a2e392eb None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.131528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 422/841] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:27.136895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.137433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.137916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.151729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.153212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a6509e-4615-4acb-ab7b-b5d150616b4e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.157067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:27.158498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:27.230651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 423/842] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:27.249853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.260869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 420/843] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:26 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:27.266498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.374355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5c7a-2244-4181-aa6c-5935c8e9362e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.400217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.411041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.411688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.411989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.412268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.415038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399724-b314-4804-b364-2ba3e02751d5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.415571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399724-b314-4804-b364-2ba3e02751d5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.419197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399724-b314-4804-b364-2ba3e02751d5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.419197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 421/844] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:27.425060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.425348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.425622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.431505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.434206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.444543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:27.445632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:27.451269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:27.452217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:27.453108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:27.453108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:27.453108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:27.454995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 424/845] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:27.468528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.527094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 422/846] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:27.528159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.586504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3bdec-b816-4385-9341-9302b0f094bf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.624349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.625377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.625875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.626361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.627365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:27.628806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.630693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.644992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 425/847] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:27.654076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdda51c-414b-4362-87e9-2bb7108a87ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.654595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.670618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.686457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.687106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.691662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.691662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.691848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.699672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:27.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:27.705813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:42:27.706691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:27.711139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 423/848] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:27.712156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.761703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f78-529b-443a-96bc-c423344f3a34 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.797139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.798041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.798480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.798750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.806299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.807933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:27.820609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:27.821469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:27.822372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 426/849] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:27.822871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.836515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332b986-90ee-41cf-a913-731a6f5ae3cd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.871043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.871944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.872440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.872709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.873372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:27.873679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.875036 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.883684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 424/850] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:27.884925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:27.933080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.938102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:27.939117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfa8fa-022b-4d3b-9c88-3532fdcaaf8d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:27.972223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:27.972864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:27.973426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:27.973896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:27.974697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:27.976536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:27.985540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:27.986621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:27.988594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 427/851] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:27.989418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.001657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfaa641-072e-44d1-8993-389fbf4ca347 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.036599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.037209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.037488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.037751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.038428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.038730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.040201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.053169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 425/852] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.053967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.092665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f087d7-5f1a-4a31-aa05-63b6391e1f6f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.128414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.129177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.129454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.129725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.139492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.140894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.149230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab8d68-9458-46a3-b97d-03bff8614dcd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.150744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-be811524-387b-435b-a1a1-57d7f7d8796b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:28.155115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:28.162282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 428/853] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66677fc-119b-418c-bd7c-dc004b44bad9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66677fc-119b-418c-bd7c-dc004b44bad9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66677fc-119b-418c-bd7c-dc004b44bad9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 429/854] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:28.163166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66677fc-119b-418c-bd7c-dc004b44bad9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.177591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.188947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.189570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.189850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.190125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.190789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.191093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.192494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.196926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 426/855] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.197697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.269056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66677fc-119b-418c-bd7c-dc004b44bad9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.296349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab430c-789b-401e-9846-7c913ba98a6a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.302890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.303503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.303774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.304087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.304806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=e30835b6a01b456bb97d745ad0052a0d) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.305118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.306539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fb312-a3b7-4c54-b2df-36c95f200a26 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.312175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 430/856] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/role_assignments?user.id=e30835b6a01b456bb97d745ad0052a0d&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.313438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61532-1343-451c-8030-668e50ed319e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.313727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61532-1343-451c-8030-668e50ed319e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.313996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61532-1343-451c-8030-668e50ed319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.332768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-18e61532-1343-451c-8030-668e50ed319e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:28.334019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-18e61532-1343-451c-8030-668e50ed319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:28.354651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.355277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.355556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.355825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.356528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.356826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.358213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.371954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 427/857] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.373312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.405162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.419622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 431/858] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:28 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:28.420550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61532-1343-451c-8030-668e50ed319e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.429909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.515417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665731cc-8bfa-410f-a0b1-23e71f648162 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.554488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61532-1343-451c-8030-668e50ed319e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.564017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.564647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.564929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.565199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.566015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.566319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.567690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.580391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 428/859] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.594714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.596157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.596671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.597700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.606739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.608600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:28.622294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:28.623294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:28.624256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:28.626868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 432/860] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:28.634283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.701894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.745745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.757625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac98d66-2315-4ed4-a758-1f1ed350c76e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.781702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:28.797484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.798171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.798501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.798779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.799518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:28.799827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.801867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.820891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67011ea1-3aa3-4cf3-8123-2b0cd4182284 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.822915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 429/861] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:28.829383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.859593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.860354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.860659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.860957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:28.861533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:28.863167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:28.881988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:28.882985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:28.883871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:28.884653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 433/862] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:28.890140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:28.952182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba5a82-1f34-406f-849d-420619d445cc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:28.988772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:28.989392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:28.989674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:28.989949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.008938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.028999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2983b-927b-48ac-9a43-0c913a1a5c41 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.062079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.063616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.069004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.076729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.077823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.078253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.078670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.079713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:29.083603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.083603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.093561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 434/863] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:29.098903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:29.195234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 430/864] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 13:42:29.196481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:29.228322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62721cd-3072-4ebd-ac41-8f10bfd9c56d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.250853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.272605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.273681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.274197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.274744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.275625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:29.276173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.277893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.291974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 435/865] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:29.314744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8756a-907f-4275-9867-c5d03ebd2a94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.354575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.355229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.355511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.355781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.368531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.370021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:29.387166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:29.388205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:29.389090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:29.389090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:29.389090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:29.389090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 431/866] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:29.397061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:29.465130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.512831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b62fc2-1e7f-4e4b-b844-aa9aab66fdb7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.550583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.551201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.551481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.551764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.552439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:29.552742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.554108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.566822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 436/867] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:29.571995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:29.682156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.685714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9dfd7-41e0-4ce4-b024-7303af06218e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.720257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.721194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.721499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.722618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.729490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.730943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:29.742676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:29.743570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:29.744480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 432/868] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:29.749865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:29.855571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70746fa4-7c2f-4d71-b34e-2ae7b4ee4e0e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:29.876042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:29.896577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:29.897472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:29.897906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:29.898338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:29.899215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:29.899698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:29.901481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a26612-ce13-48bb-a4df-bdbc9e55cfce None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:29.914781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 437/869] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:29.921226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:30.024784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51871bb-db50-4f5b-8b0d-f0af17692c19 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:30.061679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:30.062295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:30.062573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:30.062842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:30.063565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d0350bfa0d3f4b83921843e91cff8efb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:30.063873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:30.065323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d19e3-a1ab-4b0f-bf31-4a88ab8c7e75 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:30.071720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 433/870] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:29 2022] GET /identity/v3/role_assignments?user.id=d0350bfa0d3f4b83921843e91cff8efb&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:30.572027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9b83-4ecb-48ff-9750-6f6a5111a17c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:30.572416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9b83-4ecb-48ff-9750-6f6a5111a17c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:30.572595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb9b83-4ecb-48ff-9750-6f6a5111a17c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:30.574157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 438/871] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:30.579672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d1-ec0a-47a1-8cf5-6a8adf272682 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:30.579998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d1-ec0a-47a1-8cf5-6a8adf272682 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:30.580277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ad8d1-ec0a-47a1-8cf5-6a8adf272682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:30.598940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd4ad8d1-ec0a-47a1-8cf5-6a8adf272682 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:30.600169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd4ad8d1-ec0a-47a1-8cf5-6a8adf272682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:30.617850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:30.670145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 434/872] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:30.828771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f111-d2e0-4f69-b27a-60dee2426414 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:30.829329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f111-d2e0-4f69-b27a-60dee2426414 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:30.829329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54f111-d2e0-4f69-b27a-60dee2426414 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:30.830651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 439/873] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:30.835958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:30.836251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:30.836512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:30.854896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:30.856213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:30.925392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 435/874] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:30.938654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54f111-d2e0-4f69-b27a-60dee2426414 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:31.048410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54f111-d2e0-4f69-b27a-60dee2426414 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:31.085588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:31.086152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.086430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.086699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.087292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:31.088695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:31.098298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:31.099266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:31.100121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 440/875] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:31.105203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:31.193851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:31.200400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:31.212474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d856fc-6ea6-4e48-abb3-180e1074b568 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:31.249810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:31.256957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:31.258037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.258632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.259075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.260528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:31.261067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:31.263349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:31.269338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 436/876] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:31.275197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:31.312202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1719-3a1a-4ca6-8569-373b3271bf04 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:31.350328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:31.351164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.351656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.352192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.353069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:31.354637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4f7e3-c478-480a-a8ae-cbbc9c078a96 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:31.401250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2498c0-3b59-4c02-8d1d-ef0189c44969 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:31.422480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 441/877] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:31 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:31.452214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:31.453276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.453801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.454293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.455204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:31.455745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:31.457968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191b5f9-c075-4bf5-ba7e-6688a685c627 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:31.464769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 437/878] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:31 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:31.592298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1eed-0d6a-4bcc-9bca-46ca98f7ac6a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.592657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1eed-0d6a-4bcc-9bca-46ca98f7ac6a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.592923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c1eed-0d6a-4bcc-9bca-46ca98f7ac6a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.594616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 442/879] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:31.601105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edb2bb-4f1c-4d13-844b-9e2151f892f9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:31.601716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edb2bb-4f1c-4d13-844b-9e2151f892f9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:31.602202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edb2bb-4f1c-4d13-844b-9e2151f892f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:31.622580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-74edb2bb-4f1c-4d13-844b-9e2151f892f9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:31.624206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-74edb2bb-4f1c-4d13-844b-9e2151f892f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:31.626453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:31.707954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 438/880] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:31.971017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1eed-0d6a-4bcc-9bca-46ca98f7ac6a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:32.082159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c1eed-0d6a-4bcc-9bca-46ca98f7ac6a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:32.083716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:32.115985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:32.116596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:32.116873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:32.117141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:32.117796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:32.119158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48366eeb-48e3-4e7e-bbf6-22f1c320b745 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:32.221768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 443/881] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:31 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:32.412230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d110-2804-401d-8933-fe18e5b80197 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:32.412805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d110-2804-401d-8933-fe18e5b80197 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:32.412805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4d110-2804-401d-8933-fe18e5b80197 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:32.414543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 439/882] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:32.420604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:32.420900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:32.421163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:32.440501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:32.442198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:32.535359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 444/883] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:32.805941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4d110-2804-401d-8933-fe18e5b80197 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:32.918570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4d110-2804-401d-8933-fe18e5b80197 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:32.954544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:32.955168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:32.955444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:32.955709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:32.963168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:32.967454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:32.973012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:32.973915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:32.974750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 440/884] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:42:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:32.980268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.072377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:33.085822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a4aaa-4ac8-4c6b-9f21-35fc394cf92f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:33.122394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:33.123008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.123282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.123550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.124249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:33.124550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:33.125909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:33.135128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 445/885] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:42:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:33.145159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.259481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c54cf-0ae8-4710-b1c1-737ababb4b91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:33.301700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:33.301700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.301700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.302060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.312782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:33.314240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:33.329641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:33.330588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:33.332143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:33.332143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:33.332143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:33.332143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 441/886] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:33.338623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.446602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c813a03-60d4-4cae-b422-feb79ef5f142 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:33.488643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:33.489253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.489533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.489804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.490444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:33.490736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:33.492129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:33.505422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 446/887] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:33.510950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.564146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:33.621380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9bafc-148e-40bc-a6af-3ddfa6f1b3dd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:33.657919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:33.658553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.658826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.659094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.667170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:33.668638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-af1264b9-379d-4554-86fd-81ed9dcb52d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:33.680362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:33.682397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:33.683359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 442/888] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:33.693926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.706557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:33.719955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfa99-ef5e-49c6-834a-450800ab6efe None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.720238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfa99-ef5e-49c6-834a-450800ab6efe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.721332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dfa99-ef5e-49c6-834a-450800ab6efe None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.722759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 443/889] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:33.728072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ecb9-d7e0-4702-b779-06b5cddb76e5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.728382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ecb9-d7e0-4702-b779-06b5cddb76e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.728631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609ecb9-d7e0-4702-b779-06b5cddb76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.749082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0609ecb9-d7e0-4702-b779-06b5cddb76e5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:33.750314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0609ecb9-d7e0-4702-b779-06b5cddb76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:33.815201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40806d0-640d-4f81-a3dd-477ca089b6fe None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:33.853216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 444/890] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:33.876327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:33.877284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.877782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.878856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.879827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:33.880387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:33.882032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:33.884378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553c34-845c-4dcd-adb8-ac272db8a043 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.884662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553c34-845c-4dcd-adb8-ac272db8a043 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.884932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12553c34-845c-4dcd-adb8-ac272db8a043 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.886539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 445/891] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:33.891227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:33.891510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:33.891788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:33.903883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 447/892] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:33.909232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:33.911241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:33.912454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:33.954779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:33.991358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:33.997774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 446/893] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:34.030509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cf088e-5d90-4121-aecf-40f1b59ffcc5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.068048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.069046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.069561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.070110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.140486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.142680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.156887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.225487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:34.266576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 448/894] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 23 13:42:34.268022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.284998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42200e45-e65f-465b-8cbc-c8bb6fe4d789 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.321466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.322083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.322364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.322635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.323299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.324770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.375469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8ff6-a350-430f-970e-ac584c4a2f2b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.406502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 447/895] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:34 2022] POST /identity/v3/services => generated 241 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:34.406502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.429980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.431040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.431555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.432076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.444021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:34.448592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.450070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e51fe989-dd43-40c4-ac67-3142fca34392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:34.471547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:34.472633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:34.473635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:34.473635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:34.473635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:34.473635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 449/896] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:34.474575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd02c-d00b-49bc-b38f-c7528c0a6216 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.474575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd02c-d00b-49bc-b38f-c7528c0a6216 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.474761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fd02c-d00b-49bc-b38f-c7528c0a6216 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.476166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 450/897] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:34.481368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fd02c-d00b-49bc-b38f-c7528c0a6216 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.504239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:34.538837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022eb85-bec9-4ca9-8a21-bb54a0ffd544 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.576505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.577150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.577424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.577693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.578282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.580223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5278f19e-9c31-44f7-811b-35cd7b9a5bfb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:34.590705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:34.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:34.592685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 448/898] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:34.594082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.594082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.594398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.604535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fd02c-d00b-49bc-b38f-c7528c0a6216 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.613667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:34.614911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:34.641756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.642370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.642655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.642933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.643608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:34.643912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.645308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.658211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 451/899] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:34.658976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.693281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 449/900] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:34.694142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.723484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:34.754439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:34.779726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486536d-33e2-443a-a01a-324e21ef7131 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.819800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.820450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.820724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.821225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.821708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:34.822000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.823377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.831869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfefcb-5a5e-4e7d-bcb0-b6ec4b4b810b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.833925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 452/901] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:34.834782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.885757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.886766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.887727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.888216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.898050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:34.900422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:34.917728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:34.918622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:34.919501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:34.923588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 450/902] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:34.927261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:34.957747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d8938-8263-45c2-b23a-9e773b23bc28 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:34.996710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:34.997362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:34.997587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:34.997863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:34.998495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:34.998802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.000198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.007984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 453/903] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:35.007984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.012466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.035356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.052707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6267bc49-82d7-4243-9f30-34e1eb316e9b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.094305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.094918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.095202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.095475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.096192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.096503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.098449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.113757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4487cf2-4d3e-417a-b2e3-54b80fe42713 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.116151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 451/904] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:35.116848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.152697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.154227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.154518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.154797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.155442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.157066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:35.168243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:35.169186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:35.170072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 454/905] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:35.170849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.224383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab5cc-d7b2-4d98-b690-53b94ca7c0bc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.248920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.261714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.262335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.262778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.262905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.263614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] RBAC: Adding query filter params (interface=public, service_id=a685a0683c634b698e789f4f6ad0d88d, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.263941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.265342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.277852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 452/906] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/endpoints?service_id=a685a0683c634b698e789f4f6ad0d88d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:35.277852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.288837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.293553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3356c6f-07b2-4d58-937e-43faecbf6eed None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.332716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.333331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.333615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.333890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.334619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] RBAC: Adding query filter params (role.id=95fa066f81a84446b385ef8c145e555d, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d0350bfa0d3f4b83921843e91cff8efb) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.334938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.336418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.342752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 455/907] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/role_assignments?user.id=d0350bfa0d3f4b83921843e91cff8efb&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=95fa066f81a84446b385ef8c145e555d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:35.343648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.395752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b5c21-7eba-4783-bd58-1cf4c0bcb951 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.436365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.437353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.437852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.438325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.439173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.439675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.442629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.454715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 453/908] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:35.455449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.484849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349514a-025f-4a00-bd9e-29fc15b5b364 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.519760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.526108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.532370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.532370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.532370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.532370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.532370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.538962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 456/909] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/services => generated 1497 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:42:35.560589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.596692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa923ff0-2d87-4a66-936c-7fb92c8c671f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.637007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.637997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.638633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.639090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.639942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.640450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.642038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.649077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 454/910] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:35.658868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.771959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00080261-2327-4f4a-89fe-2e8ca3b87c1c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.806833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.807766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.808229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.808664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.809543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] RBAC: Adding query filter params (interface=public, service_id=c447359d98f14b81b85be3229eed5bc9, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:35.810000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.811555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdbe89-9cc7-4c3b-a6b3-8041774fa383 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.817855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 457/911] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/endpoints?service_id=c447359d98f14b81b85be3229eed5bc9&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:35.823836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:35.931618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8311-ab33-4e3a-9449-07cb45b0d267 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:35.970700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:35.971316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:35.971623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:35.971900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:35.972530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:35.973959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8578ac3d-26f0-4c94-b4d8-3f527128303f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:35.975704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:35.981159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 455/912] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:35 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:42:36.610162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabee6-cdef-4f7a-8923-d60d309add85 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:36.611163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabee6-cdef-4f7a-8923-d60d309add85 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:36.611675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eabee6-cdef-4f7a-8923-d60d309add85 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:36.614136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 458/913] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:36.619130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:36.619542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:36.619743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:36.637831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:36.639011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:36.709621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 456/914] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:36.978983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eabee6-cdef-4f7a-8923-d60d309add85 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:37.041174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:37.084153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eabee6-cdef-4f7a-8923-d60d309add85 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:37.118294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:37.119290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.119815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.120333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.121142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:37.122720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:37.133099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:37.134118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:37.134944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:37.137664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 459/915] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:37.147963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:37.248843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062b35-38f4-4567-843c-3109807d1d27 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:37.280817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:37.287366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:37.290873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.290873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.290873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.290873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:37.290873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:37.291245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:37.296549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 457/916] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:37.302376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:37.407506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e88c4-27e1-4f26-b9f6-1718f960931e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:37.431821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:37.443122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:37.443741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.444107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.444406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.445051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:37.451034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:37.451034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:37.452140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 460/917] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:37.465927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:37.585427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3400c-4273-4c9e-b207-badc715bd609 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:37.620405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:37.621033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.621324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.621560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.622267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] RBAC: Adding query filter params (interface=public, service_id=96485e5f2caf4a5287a59bb7e4e4817c, region_id=RegionOne) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:37.622577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:37.623968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0ddb3-c53f-4ec6-8c12-6e20955bb067 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:37.630355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 458/918] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:37 2022] GET /identity/v3/endpoints?service_id=96485e5f2caf4a5287a59bb7e4e4817c&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:37.637247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:37.663741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352aa9-cf2f-4aea-99c3-30baac07279a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.664084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352aa9-cf2f-4aea-99c3-30baac07279a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.664351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba352aa9-cf2f-4aea-99c3-30baac07279a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.666842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 459/919] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:37.673400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca5bb-7ff4-4db4-83eb-6ddd37be2f6e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.674026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca5bb-7ff4-4db4-83eb-6ddd37be2f6e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.675369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddca5bb-7ff4-4db4-83eb-6ddd37be2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.702188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8ddca5bb-7ff4-4db4-83eb-6ddd37be2f6e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:37.704285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8ddca5bb-7ff4-4db4-83eb-6ddd37be2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:37.760216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e3725-a739-44d8-afec-451ca04ddc70 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:37.777351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:37.800351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 460/920] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:37.800351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1eaf-1d65-4543-8027-fe2e668f933b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.800351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1eaf-1d65-4543-8027-fe2e668f933b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.800351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b1eaf-1d65-4543-8027-fe2e668f933b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.803881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 461/921] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:37.808211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.808342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:37.808790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.809215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:37.809493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.809680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:37.810046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:37.810753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:37.812394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:37.828360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 461/922] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:37 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:42:37.830577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:37.832064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:37.917269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 462/923] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:38.076074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.133426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.190028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e123145-7d17-4d64-b73c-3047d4709598 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.218464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.230689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.231332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.231611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.231885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.243802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:38.249720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:38.250701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:38.251540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 462/924] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:38.259403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.329774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd8613-3993-40d3-8ba2-aa8886c74b32 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.347112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.364525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.366554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.366554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.366554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.366554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.367844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.376296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3141514-4e6b-42a0-826f-1efee9c77a42 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-39378f4a-2752-49f6-9f6a-077887a6197e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:38.376850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:38.378568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:38.379379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 463/925] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:38.380218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ec5b-e2e5-49c9-967e-1ee7faf9a1a3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.380952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ec5b-e2e5-49c9-967e-1ee7faf9a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.380952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ec5b-e2e5-49c9-967e-1ee7faf9a1a3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.386242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 464/926] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:38.386940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ec5b-e2e5-49c9-967e-1ee7faf9a1a3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.395582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.421730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.422645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.423125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.423695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.425225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:38.425536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.426898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f07aab-9c56-4b57-b797-4f28210b8d06 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.439652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 463/927] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:38.439652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659212ec-4473-4627-a914-70cb665175ec None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.439652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659212ec-4473-4627-a914-70cb665175ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.439652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659212ec-4473-4627-a914-70cb665175ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.458819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-659212ec-4473-4627-a914-70cb665175ec None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:38.460075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-659212ec-4473-4627-a914-70cb665175ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:38.500326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ec5b-e2e5-49c9-967e-1ee7faf9a1a3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.535541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.536186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.536470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.536744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.537492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:38.537800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.539168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.542247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 464/928] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:38.543409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659212ec-4473-4627-a914-70cb665175ec None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.547951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 465/929] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:38.552412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.606712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.667562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9f0c2-38ca-40e2-ada1-b7c4a61caec7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.681335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659212ec-4473-4627-a914-70cb665175ec None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.685775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.703130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.703880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.705499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.705782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.706472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:38.706784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.708200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.719034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 466/930] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:38.720159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.729410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.730475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.730962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.732255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.746371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.748030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:38.765136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:38.766086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:38.766994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:38.766994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:38.766994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:38.769148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 465/931] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:38.778563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.842988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6389-016f-40f1-a327-b605c7e1cd83 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.853623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:38.878553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.879172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.879454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.879730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.880422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.881785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.888556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae091db-c3ea-46ed-a6b8-a7cecd1846f7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:38.921704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:38.922327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:38.922638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:38.922911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:38.923544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:38.923869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:38.925881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:38.937721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 466/932] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:38.938373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.951950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 467/933] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:38.951950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:38.964593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.073691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b854-b065-4fca-918b-5e09267e27fd None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.078961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee05ee6-bf24-47e7-9350-242d281cd33f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.118484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.119135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.119419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.119693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.120374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.120725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.121481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.121756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.121859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.122025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.131698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:39.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:39.133822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 23 13:42:39.134711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:39.135499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.135576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 467/934] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:39.141467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:39.155157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:39.157052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:39.159088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:39.160354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 468/935] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:39.164511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.194668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.248352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.275438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c462523-9a1b-4465-9232-16a4b649ed5f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.287427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaab86d-0d29-49e1-9146-36d37399e096 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.320383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.321004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.321289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.321564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.322198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:39.322504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.323937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.324274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.325002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.325353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.325865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.326844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:39.327358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.328894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.329311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 468/936] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:39.335873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.355587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 469/937] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:39.361341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.459687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.470016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086d013-b015-4700-b328-29bb46cdf682 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.485910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34108e5-3a7c-44af-a295-82b2cde728c2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.507293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.508099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.508589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.508958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.509783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:39.510188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.511647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.525427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 469/938] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:39.527112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.533437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.534249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.534627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.535000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.541564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.546709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.548607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:39.564625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:39.566307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:39.567368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:39.567368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:39.567368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:39.573492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 470/939] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:39.574559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.654340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ceb663-e0be-44e8-b750-8e3c174e2f6d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.691482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.692316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.692712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.693131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.693901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.694365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf681b-9f6c-47d5-8371-b635a12308de None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.695456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.727147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:39.732174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.732788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.733065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.733335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.733988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:39.734273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.735643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.748078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 471/940] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:39.754069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:39.816433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 470/941] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:39.867991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf372ff-af8d-4075-abf8-a03780dba162 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:39.912457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:39.913102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:39.913382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:39.913653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:39.921820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:39.923338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f2ed040b-8fc1-4d21-ba28-de4efdf708c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:39.937269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:39.938237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:39.939124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:39.943492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 472/942] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:39.946517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:40.016705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:40.058640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411f4b-2ef5-472d-af08-560c1542ecaf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.058975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411f4b-2ef5-472d-af08-560c1542ecaf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.059244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9411f4b-2ef5-472d-af08-560c1542ecaf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.062260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 473/943] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:40.062863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1029cf45-2878-43a3-9e6e-a70d92093b5b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:40.066507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.066788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.067061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.086822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:40.088154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:40.105981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:40.106589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.106866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.107190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.107875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:40.108262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:40.109678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:40.127735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 471/944] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:40.129892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:40.137642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:40.169252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 474/945] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:40.233955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be0cc7-0c51-4b84-ab3b-e13d0c88f62d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:40.258452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:40.269301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:40.270011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.270299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.270558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d0350bfa0d3f4b83921843e91cff8efb/roles/95fa066f81a84446b385ef8c145e555d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.272758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=d0350bfa0d3f4b83921843e91cff8efb, role_id=95fa066f81a84446b385ef8c145e555d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:40.274320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:40.343291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 472/946] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:42:40 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/d0350bfa0d3f4b83921843e91cff8efb/roles/95fa066f81a84446b385ef8c145e555d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 13:42:40.477079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:40.589261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2427d-0a87-42ee-b3a7-2e7483f58f44 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:40.628155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:40.629155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.629664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.630150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.630926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:40.632515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:40.641902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:40.642895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:40.644286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:40.647002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 475/947] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:40.653158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:40.756251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e17bc-ba3e-4f11-8318-d75a02d5b4ff None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:40.797309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:40.797898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.798175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.798446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.799066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:40.799366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:40.800785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:40.805820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 473/948] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:40.811391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:40.858949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:40.924108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b2ff0-67de-46b5-9568-b5e42fd88527 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:40.959780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:40.960742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:40.961310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:40.961798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:40.962643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:40.963148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:40.964726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1346c-c19a-4853-ba49-155003e05725 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:40.970094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 476/949] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:40.976049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:41.026294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:41.076735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec90f3f-05e9-4935-8b6b-90f251cce2a6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:41.112253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:41.113373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:41.113651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:41.113921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:41.114582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:41.115965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32369387-3690-48aa-85d2-cefde12ed18d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:41.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 474/950] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:40 2022] POST /identity/v3/endpoints => generated 349 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:41.276645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb62c-a2cc-4e07-a0d7-f8bf9e941e4a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:41.276818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb62c-a2cc-4e07-a0d7-f8bf9e941e4a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:41.277071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb62c-a2cc-4e07-a0d7-f8bf9e941e4a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:41.278806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 477/951] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:41.284745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:41.285047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:41.285307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:41.306890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:41.308221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:41.388301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 475/952] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:41.664097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb62c-a2cc-4e07-a0d7-f8bf9e941e4a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:41.772918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb62c-a2cc-4e07-a0d7-f8bf9e941e4a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:41.780168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:41.808540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:41.809151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:41.809425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:41.809695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:41.810338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:41.811762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:41.814433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING keystone.server.flask.common [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 13:42:41.869577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.sql.core [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 13:42:41.869577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 13:42:41.869577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [parameters: {'id': 'd531c52915a540d9929104813a2c3b5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 13:42:41.869577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81863) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d531c52915a540d9929104813a2c3b5d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d531c52915a540d9929104813a2c3b5d. Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:42:41.877535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 23 13:42:41.878357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application yield resource Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise self.value Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application session.commit() Sep 23 13:42:41.879292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.session.flush() Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application compat.raise_( Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 13:42:41.880221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 13:42:41.881119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application result.read() Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:42:41.881920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [parameters: {'id': 'd531c52915a540d9929104813a2c3b5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:41.882750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:41.883685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d531c52915a540d9929104813a2c3b5d. Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:41.886702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 478/953] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Sep 23 13:42:41 2022] POST /identity/v3/projects => generated 262 bytes in 216 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:41.895970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:41.925612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:42.002049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86eec1-ee4d-4f83-b084-ec9c01bd7f62 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:42.037522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:42.038154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.038433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.038704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.045804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:42.047269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-567f97bb-404a-4bae-b7ec-add478e99475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:42.058727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:42.059682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:42.060631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 476/954] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:42.067881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:42.180787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887de347-d431-4bdf-bbef-00e11ea4ebc0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:42.216293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:42.216907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.217189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.217456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.218112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:42.218411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:42.220054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07fd8b-5050-45ad-8df4-08ea2a10d6eb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:42.241572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 479/955] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:42.255236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af14-e26c-46fb-a39c-e76d3443a20c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.255550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af14-e26c-46fb-a39c-e76d3443a20c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.255782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6af14-e26c-46fb-a39c-e76d3443a20c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.257375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 477/956] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:42.265032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c0-3d43-48b5-a384-aeff271243e7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.265032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c0-3d43-48b5-a384-aeff271243e7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.265032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c70c0-3d43-48b5-a384-aeff271243e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.285823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d00c70c0-3d43-48b5-a384-aeff271243e7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:42.287446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d00c70c0-3d43-48b5-a384-aeff271243e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:42.307429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:42.365802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 480/957] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:42.621019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f794-61c0-477a-9f17-6d9629a2f247 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.621370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f794-61c0-477a-9f17-6d9629a2f247 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.621565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7f794-61c0-477a-9f17-6d9629a2f247 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.623214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 478/958] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:42.628955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.629250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.629528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.634732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f794-61c0-477a-9f17-6d9629a2f247 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:42.650473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:42.651663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:42.725503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 481/959] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:42.745247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:42.756189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7f794-61c0-477a-9f17-6d9629a2f247 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:42.790067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:42.790947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.791224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.791492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.792095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:42.793451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:42.803128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:42.804223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:42.805058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 479/960] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:42.810451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:42.897105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:42.921063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6186a5f-49f7-490f-a190-b793c0c93030 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:42.958040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:42.958931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:42.959360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:42.959793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:42.960612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:42.961135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:42.962645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:42.968233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 482/961] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:42.976005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.042904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.078057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a8b5a-269c-4085-9e73-2d90a358b813 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.120537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.122362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.122855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.123333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.124228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:43.124737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.126844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.133582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 480/962] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:43.158154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b80d-4c53-49b7-b41f-3341f0167354 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.199150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.199807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.200117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.200389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.212742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2901c9bc-88c5-4467-933d-cbbeaddf729b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:43.217864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:43.227782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:43.228683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 483/963] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:43.231260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.256453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:43.353346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6bb7-4d15-4840-9d90-7bb2425c5f16 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.389056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.389967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.390426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.390879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.391749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:43.392177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ef785-0b30-4741-b087-6be42ff0961d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.392466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ef785-0b30-4741-b087-6be42ff0961d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.392584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.392740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2ef785-0b30-4741-b087-6be42ff0961d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.394328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.396037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 484/964] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:43.400220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.400336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.400520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.407529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 481/965] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:43.413311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.414496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:43.420664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:43.422008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:43.503845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 485/966] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:43.516592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:43.539313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773be50-fabf-445f-b6ab-3dc7c6c30d88 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.574235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.574874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.575157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.575431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.586630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.588302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:43.603276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:43.604282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:43.605168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:43.605168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:43.605168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:43.605168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 482/967] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:43.613045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.720130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880639-5870-4f76-bd71-519152f2ee0b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.756307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.756845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.757128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.757402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.758044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:43.758345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.759779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.762670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:43.773259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 486/968] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:43.780930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.781068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.899670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ece22-f295-46d8-b78e-e315fc09b1f4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.901532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f92c5-6448-400e-9d56-ec376a36be4c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:43.932750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:43.937781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.938647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.939097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.944268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.944268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.944268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.944542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:43.945663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:43.945952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:43.946229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:43.952569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:43.953787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:43.954801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:43.956809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:43.956809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:43.959962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 483/969] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:43.963115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:43.976849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:43.977953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 23 13:42:43.979445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:43.983034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 487/970] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:43.983882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.064657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.077466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafbd5-ea87-4af3-9a28-0523b7162ea1 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.116251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.117227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.117726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.118193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.119048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:44.119549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.121194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.126188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ff1bc-0c5f-4705-95fb-aff62c166be0 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.127362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 484/971] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:44.133082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.180051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.181035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.181693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.182600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.183933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:44.184426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.186699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.196260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.216882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 488/972] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Sep 23 13:42:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:44.219347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.245079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a5d0-970d-47fb-939f-e136459daa2a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.287252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.287890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.288196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.288472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.289146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:44.289387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.291042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.300896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 485/973] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:44.303557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.344487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ca51c-dde1-40b7-95cd-274657492364 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.359537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.381547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.382348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.382703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.383113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.434650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edeaab-fa49-4e4d-a80e-b98496150d7d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.476999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.477574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.479084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff3fcb-66cb-4cb6-9cb8-3ffa4ef0b9e9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.480744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.481473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.481821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.482287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.482957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] RBAC: Adding query filter params (interface=admin, service_id=96485e5f2caf4a5287a59bb7e4e4817c, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:44.483335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.484851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.495900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 486/974] 10.222.0.48 () {56 vars in 1249 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/endpoints?service_id=96485e5f2caf4a5287a59bb7e4e4817c&interface=admin®ion_id=RegionOne => generated 193 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:44.497218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.601149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65c50d-d61c-461d-909e-30965388d395 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.607371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 489/975] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:44.608950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ce37-e13d-4132-97e0-01f347f457e5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.609236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ce37-e13d-4132-97e0-01f347f457e5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.609511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e066ce37-e13d-4132-97e0-01f347f457e5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.610904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 490/976] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:44.612784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066ce37-e13d-4132-97e0-01f347f457e5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.631175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.642147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.642753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.643028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.644022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.644524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.645907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456bb0a-3c37-4da4-a1aa-cb696591fb32 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.651766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 487/977] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:42:44.657468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.658079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.659129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.689026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:44.691352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:44.735208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e066ce37-e13d-4132-97e0-01f347f457e5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.760120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:44.778316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.779459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.779989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.780501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.791960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 488/978] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:44.795499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.797007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:44.813733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:44.814774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:44.816237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:44.816237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:44.816237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:44.816237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 491/979] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:44.821414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:44.932696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac7b7b-c243-49eb-819b-038c58c4471d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:44.968830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:44.969807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:44.970313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:44.970798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:44.971703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:44.972239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:44.973797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:44.986119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 489/980] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:44.991953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.062302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:45.071054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.100733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157bff5-3e5d-4f66-8a0c-2028e77345e7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.122426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:45.138921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.139560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.139841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.140145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.147218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.148709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:45.160375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:45.161474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:45.162576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:45.166619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 492/981] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:45.167894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.201162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460fb8-7c3e-4f3c-aa44-55ad2a2734b5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.244730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.245689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.246039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.246449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.247257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.248794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.251443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING keystone.server.flask.common [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 23 13:42:45.281202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0371-69e6-4a10-b5f4-9c5fb787af55 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.298725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.sql.core [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 13:42:45.298725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 13:42:45.298725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [parameters: {'user_id': '07302ea2d4524e688f0dac68ce9e60b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 13:42:45.298725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81864) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 23 13:42:45.310587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:45.319858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.323853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.323853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.323853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.323853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:45.323853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result.read() Sep 23 13:42:45.324333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:42:45.325143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application yield resource Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application next(self.gen) Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.session.rollback() Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.force_reraise() Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise self.value Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application session.commit() Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 23 13:42:45.326120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._prepare_impl() Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.session.flush() Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._flush(objects) Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application compat.raise_( Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application flush_context.execute() Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rec.execute(self) Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 23 13:42:45.326997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 23 13:42:45.328621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result = self._query(query) Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application conn.query(q) Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application result.read() Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 23 13:42:45.329472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [parameters: {'user_id': '07302ea2d4524e688f0dac68ce9e60b5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:45.330283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 23 13:42:45.331182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 23 13:42:45.332085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.332431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.333826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 490/982] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Sep 23 13:42:45 2022] POST /identity/v3/users => generated 160 bytes in 263 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:45.339856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.341350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 493/983] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:45.350408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.464018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7d53-b3af-4c77-8fe2-c0bf83eef96e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.468379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:45.473519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed26340-6bf6-42b7-8ea7-dab4e9ced36a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.502551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.503244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.503523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.503796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.511229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.513237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.513728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.514508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.515109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.515548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.516894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] RBAC: Adding query filter params (role.id=95fa066f81a84446b385ef8c145e555d, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=d0350bfa0d3f4b83921843e91cff8efb) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:45.517391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.518996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e672b5-76a5-4423-8638-3b127bc9b4d2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-157e7d9e-f329-4111-8a86-5b17edd2dd3d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:45.524919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:45.526070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:45.527022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 491/984] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:45.527610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198c90-9de8-4e6b-9600-06969b5bc181 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.527610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198c90-9de8-4e6b-9600-06969b5bc181 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.527752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b198c90-9de8-4e6b-9600-06969b5bc181 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.528601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 494/985] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:45 2022] GET /identity/v3/role_assignments?user.id=d0350bfa0d3f4b83921843e91cff8efb&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=95fa066f81a84446b385ef8c145e555d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:45.531885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 492/986] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:45.537866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.538157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.538504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.542375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198c90-9de8-4e6b-9600-06969b5bc181 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:45.559487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:45.560742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:45.620413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:45.658433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 495/987] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:45.682435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b198c90-9de8-4e6b-9600-06969b5bc181 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:45.722204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:45.723216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:45.723742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:45.724216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:45.725189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:45.725701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:45.727441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34579d48-98bb-4cca-95fd-c2fe8e2e7486 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:45.765063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 493/988] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Sep 23 13:42:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:45.942340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:46.048927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f981689-e932-45ad-9d8f-256a896db926 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:46.084258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:46.084873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:46.085153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:46.085428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:46.086079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:46.087480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791699b-f50f-41a8-be2a-58dfa317bc2b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:46.162383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 496/989] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:45 2022] POST /identity/v3/services => generated 242 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:46.883738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855eaa8-73ec-4645-8f69-f28cdf44efa2 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:46.884290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855eaa8-73ec-4645-8f69-f28cdf44efa2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:46.884369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855eaa8-73ec-4645-8f69-f28cdf44efa2 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:46.885699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 494/990] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:46.890822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:46.891110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:46.891383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:46.909808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:46.910978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:46.945442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:46.985032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 497/991] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:47.256175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855eaa8-73ec-4645-8f69-f28cdf44efa2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:47.280956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:47.361081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855eaa8-73ec-4645-8f69-f28cdf44efa2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:47.395492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:47.396154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.396434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.396700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.397281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:47.398637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:47.407852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:47.409423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 23 13:42:47.410281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:47.411635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 495/992] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Sep 23 13:42:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:47.415635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:47.522772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c2eb6-8f9c-42d1-a4aa-21e8a1527f2b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:47.555836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:47.556470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.556749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.557025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.557632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:47.557931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:47.559283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:47.564078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 498/993] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:47.570325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:47.656237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:47.673287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f190b1-5af6-4208-8756-66a99fe7c1e7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:47.708471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:47.709080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.709356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.709624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.710247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:47.710547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:47.711979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbca00-24a8-47b3-a3d8-a99300c341f8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:47.721595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 496/994] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Sep 23 13:42:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:47.722802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:47.754983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:47.766931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8b55-9021-42f3-927b-d22bc385a0d1 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.767224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8b55-9021-42f3-927b-d22bc385a0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.767487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b8b55-9021-42f3-927b-d22bc385a0d1 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.769398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 497/995] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:47.774417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.774719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.774907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.792895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:47.794403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:47.833019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccb4b2-b8ca-4327-aecb-8d5281ffa715 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:47.862481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 498/996] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:47.869391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:47.870003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:47.870280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:47.870551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:47.871215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:47.872609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db8a91-3fad-4783-87ac-440810bec32e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:47.955957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 499/997] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:48.131786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:48.215724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:48.237723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db1ff7-8219-426d-9a37-00c29917c1dd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:48.331595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:48.332266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.332543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.332811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.333396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:48.334780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:48.343788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb464e9-bfd4-4b59-a438-0f565b0ed98a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-ea4cb367-01f2-4c8f-9431-94b3b9876ab6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:48.344030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:48.344965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:48.348883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:48.349623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb464e9-bfd4-4b59-a438-0f565b0ed98a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.349623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb464e9-bfd4-4b59-a438-0f565b0ed98a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.349760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 499/998] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 13:42:48 2022] GET /identity/v3/services/image => generated 86 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:48.349829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 500/999] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:48.351503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.351637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb464e9-bfd4-4b59-a438-0f565b0ed98a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:48.351792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.352155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.372992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:48.374180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:48.443562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 500/1000] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:48 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:48.471908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:48.482239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb464e9-bfd4-4b59-a438-0f565b0ed98a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:48.517178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:48.517788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.518105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.518366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.518992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:48.519294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:48.520726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:48.525557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 501/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:48.530963 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:48.602044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:48.636080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411becc0-1718-4d5b-9994-ac6d246a2092 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:48.670505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:48.671122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.671404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.671676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.672333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:48.672636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:48.673997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:48.688204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 501/1002] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:48.720073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:48.827828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62ae0d-3d7b-48df-bfac-ebcdaa46b2bb None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:48.869255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:48.869478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:48.869598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:48.870154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] PATH_INFO: `/v3/services/compute` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:48.870450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:48.871876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:48.881581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:48.882598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:48.883445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 502/1003] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:48.888700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:48.995608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4022546-d7ef-4768-b890-b07669a340d5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:49.029665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:49.030278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:49.030560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:49.030832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:49.031453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:49.031760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:49.033165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:49.034841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:49.039358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 502/1004] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:49.045550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:49.065674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:49.146727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78d627-c794-4c67-9a7c-139b11c2c55d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:49.181086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:49.181879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:49.182015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:49.182250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:49.182888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:49.183228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:49.184528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:49.189547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 503/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:49.195620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:49.298580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442249e-6d4a-44fe-b808-417a61764420 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:49.332368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:49.332986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:49.333269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:49.333544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:49.334244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] RBAC: Adding query filter params (interface=public, service_id=9ece54d9614e46ea83e5ecc102013219, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:49.334555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:49.335928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3a017-c3d5-4f61-a133-7290d3a084c4 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:49.345573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 503/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:49 2022] GET /identity/v3/endpoints?service_id=9ece54d9614e46ea83e5ecc102013219&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:49.346741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:49.428975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:49.448106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39918fac-4c39-44c4-abae-2dc1a0f3665f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:49.483312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:49.483937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:49.484236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:49.484494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:49.485087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:49.486446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7a595-bb75-4d93-89ab-1e6224726064 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:49.493516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 504/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:49 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 13:42:50.134349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8415-b588-42af-a0b6-5aed8539e674 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.134683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8415-b588-42af-a0b6-5aed8539e674 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.134906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb8415-b588-42af-a0b6-5aed8539e674 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.136530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 504/1008] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:50.141768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.142052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.142324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.160621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:50.161786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:50.229117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 505/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:50.499110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb8415-b588-42af-a0b6-5aed8539e674 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:50.562337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:50.600041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb8415-b588-42af-a0b6-5aed8539e674 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:50.634255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:50.634879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.635156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.635427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.636500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:50.637913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8100e-b0b8-4f8e-b659-8d251e69aa5e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:50.639619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 505/1010] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:50.645799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:50.725542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:50.748001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de7ad0-5034-4164-9196-f76659735ff0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:50.786513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:50.787137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.787415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.787683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.788365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:50.789799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4bf5e3-c58a-4df5-ac60-539b45b05e0b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:50.875912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd5a-b7c7-472e-8117-7be099ca4922 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.876264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd5a-b7c7-472e-8117-7be099ca4922 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.876535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd5a-b7c7-472e-8117-7be099ca4922 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.878065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 506/1011] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:50 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:50.878502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 506/1012] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:50.883901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486af2-b4bd-4eba-83d3-115f660e8269 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:50.884225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486af2-b4bd-4eba-83d3-115f660e8269 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:50.884502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40486af2-b4bd-4eba-83d3-115f660e8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:50.905612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-40486af2-b4bd-4eba-83d3-115f660e8269 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:50.906843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-40486af2-b4bd-4eba-83d3-115f660e8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:50.980978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 507/1013] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:50 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:51.249424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dcd5a-b7c7-472e-8117-7be099ca4922 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:51.352932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dcd5a-b7c7-472e-8117-7be099ca4922 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:51.382492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:51.388523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:51.389136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:51.389412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:51.389682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:51.390328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:51.391694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268113c4-6929-4c0a-8b7e-082ca4ee143f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:51.499762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 507/1014] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:42:51 2022] POST /identity/v3/services => generated 242 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:51.673575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9303-84b4-4086-8952-71c8acb96f0e None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:51.673575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9303-84b4-4086-8952-71c8acb96f0e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:51.673575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d9303-84b4-4086-8952-71c8acb96f0e None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:51.675535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 508/1015] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:51.680686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:51.681046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:51.681395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:51.701213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:51.702429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:51.778225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 508/1016] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:51 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:52.050763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9303-84b4-4086-8952-71c8acb96f0e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:52.112801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:52.154510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d9303-84b4-4086-8952-71c8acb96f0e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:52.188117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:52.189020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:52.189289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:52.189617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:52.190876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:52.192758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:52.201548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:52.205012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:52.206426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 509/1017] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:52.209188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:52.310120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c5ad3-c4ef-4be1-83d4-39fe82194ca5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:52.326453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:52.344249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:52.344855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:52.345133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:52.345405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:52.346024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:52.346374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:52.347779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:52.357151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 509/1018] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:52.358493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:52.470436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e247f76-b3b6-4a0d-8125-a374932e5b37 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:52.494391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:52.506551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:52.507163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:52.507515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:52.507741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:52.508372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:52.508679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:52.510049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7ec3-2d93-4a0f-a934-2122ed5ba48b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:52.516064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 510/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Sep 23 13:42:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:52.520855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:52.621815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0e77-10df-4eb7-95db-c81d778c7311 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:52.655195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:52.655800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:52.656106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:52.656380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:52.657036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:52.658397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269b407-bd63-449d-8047-1e49427029ab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:52.733224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 510/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:53.073718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514d60-3d85-43a3-9ad6-5c34f548d690 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.074238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514d60-3d85-43a3-9ad6-5c34f548d690 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.074347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61514d60-3d85-43a3-9ad6-5c34f548d690 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.075761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 511/1021] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:53.081103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.081398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.081682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.100123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:53.101330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:53.130561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:53.176629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 511/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:53.445613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514d60-3d85-43a3-9ad6-5c34f548d690 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:53.555518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61514d60-3d85-43a3-9ad6-5c34f548d690 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:53.594135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:53.595154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.595660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.596249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.597695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:53.599299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bf53e-e2dd-431a-bd6d-e564e6dc2d46 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:53.601426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 512/1023] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:53.607165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:53.691049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d101d-3e76-4dd4-a999-f5835d73e265 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.691376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d101d-3e76-4dd4-a999-f5835d73e265 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.691607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d101d-3e76-4dd4-a999-f5835d73e265 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.692972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 513/1024] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:53.697982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.698195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.698469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.712592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050369e-b3b0-4934-ab99-0640612c258f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:53.718046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:53.719272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:53.755758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:53.756398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:53.756676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:53.757632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:53.757632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:53.758991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:53.772702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:53.789479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 514/1025] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:53.904351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 512/1026] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:42:53 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 13:42:54.055891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:54.158311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdcfcd-073c-463e-bc44-06113c4dbef8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:54.193674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:54.194576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:54.195002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:54.195417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:54.196177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:54.197683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:54.206493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:54.207653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:54.208573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:54.209316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 515/1027] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 13:42:54 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:54.215232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:54.235554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:54.317212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70188f-958e-4027-abe4-a9c1c212facf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:54.350158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:54.350769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:54.351052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:54.351324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:54.351966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] RBAC: Adding query filter params (name=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:54.352272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:54.353640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:54.363775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 513/1028] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:54.365366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:54.417535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:54.472338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc60d8-09aa-4766-8a31-91d92983ccd4 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:54.507461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:54.508110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:54.508393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:54.508665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:54.509287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] RBAC: Adding query filter params (type=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:54.509586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:54.511009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:54.520827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 516/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:54.522391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:54.606492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:54.625197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edafcbf-edd6-4c0e-8160-8996ba67684f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:54.659409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:54.660051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:54.660335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:54.660610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:54.661307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] RBAC: Adding query filter params (interface=public, service_id=843320b2e0dc4f4caf447a417aaf0343, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:54.661618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:54.662974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660d60b-096d-4ab8-97ec-90d805a85b8f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:54.671964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 514/1030] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:42:54 2022] GET /identity/v3/endpoints?service_id=843320b2e0dc4f4caf447a417aaf0343&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:54.675231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:54.779479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98c441-8510-47e5-88d9-3f6f97712c91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:54.793387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:54.813482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef565c-f3d7-420b-90b5-67f6b6c7b9d2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:54.823358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 517/1031] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:42:54 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:42:55.013634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3a2e4-e0d5-4a06-9ada-26723a539ea7 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:55.013984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3a2e4-e0d5-4a06-9ada-26723a539ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:55.014190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3a2e4-e0d5-4a06-9ada-26723a539ea7 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:55.015527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 515/1032] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:55.021377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:55.021672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:55.021954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:55.041913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:55.043134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:55.110710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 518/1033] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:55.376336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3a2e4-e0d5-4a06-9ada-26723a539ea7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:55.484958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3a2e4-e0d5-4a06-9ada-26723a539ea7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:55.519002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:55.519636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:55.519930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:55.520215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:55.530893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:55.535824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:55.536977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:42:55.537826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:55.540277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 516/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:42:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:55.543099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:55.642092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337742df-5a55-4e6f-8aeb-9eaf38d0bdf6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:55.649463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:55.676886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:55.677503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:55.677785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:55.678056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:55.678721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:55.679025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:55.680433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:55.694116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 519/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:42:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:55.695963 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:55.705897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:55.797928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ae47-5d51-4b3b-a853-f934d2da6446 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:55.831073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:55.831701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:55.832006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:55.832281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:55.842556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:55.844082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:55.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:55.859618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:55.865939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:55.865939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:55.865939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:55.865939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 517/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:55.867811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:55.968631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eada543-13a4-45e1-b626-f707f97e74e1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.002577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.003222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.003502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.003777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.004475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:56.004781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.006203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c67b9e1-1b43-4c77-a959-789198f0045c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.021207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 520/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:56.026111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.087033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.124969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0d7f-b6a2-485b-9ad2-6be21b4eb342 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.125255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0d7f-b6a2-485b-9ad2-6be21b4eb342 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.125529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc0d7f-b6a2-485b-9ad2-6be21b4eb342 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.126859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 521/1038] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:42:56.129463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f4c8-7ac3-4d4b-855d-9b79caf3ffec None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.131716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.132055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.132323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.149679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:56.150840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:56.167125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.168079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.168586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.169035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.173662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.180285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.181972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:42:56.195802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:56.196806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:56.197760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 518/1039] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:56.203033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.236025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 522/1040] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:42:56.305649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ade80-a1ab-471b-af07-cef75ec186e7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.322410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.339438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.340068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.340346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.340613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.341319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:56.341619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.343120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.366043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 519/1041] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:56.367683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.472843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768580c-c85f-4947-82bc-1e30efabb62b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.499840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.508941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.509562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.509840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.510111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.541055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.585110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.586671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.608545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b73e3e-b937-45e9-979b-cfa25d1527ec None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.646654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.647276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.647552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.647822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.657801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:42:56.663032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:56.663962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:42:56.664794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:42:56.667293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 520/1042] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:42:56.673231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.689448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 523/1043] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:56.695433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.716300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.754786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.787285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e60be-1ca9-48f0-8521-71945f200f34 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.798803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e68810-d1d6-4b98-81ac-ab8e185383b2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.822208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.822819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.823097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.823584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.824045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:56.824348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.825717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.839095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 521/1044] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:56.839279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.839279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.839279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.839279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.840111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.851366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:56.853226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:42:56.869061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:56.870075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:42:56.870973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:42:56.870973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:42:56.870973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:56.870973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 524/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:56.876258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:56.954086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:56.957614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e55eca-066d-4913-8bb9-cb7de01166ab None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.983381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7e850-f22f-440b-ac69-92d0d7a0c19b None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:56.991806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:56.992466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:56.992745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:56.993019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] PATH_INFO: `/v3/users/74e319df21e64c5d9da5a77bccf3accf` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:56.994379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.010258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] RBAC: Authorizing `identity:get_user(user_id=74e319df21e64c5d9da5a77bccf3accf)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.010258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b510a42-d7ca-47de-90a1-88f80079fd9e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.015256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 522/1046] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/users/74e319df21e64c5d9da5a77bccf3accf => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:57.015256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341366e5-0484-4593-a194-5b9c7324b705 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.015256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341366e5-0484-4593-a194-5b9c7324b705 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.015256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341366e5-0484-4593-a194-5b9c7324b705 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.015256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 523/1047] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:57.016289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341366e5-0484-4593-a194-5b9c7324b705 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.017743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.018390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.018670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.018945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.019588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.019883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.021284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0cc31-62ca-4e17-a198-88f8f7044b51 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.033591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 525/1048] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:57.034918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.035201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.035472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.053526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:57.054722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:57.119982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 526/1049] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:57.120802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.130146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341366e5-0484-4593-a194-5b9c7324b705 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.166599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.167208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.167491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.167764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.193902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.227249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.230248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d8eec-939b-47d7-88c6-7de64b9dd9e8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.241303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.242764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.266256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.266824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.267109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.267392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.274786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.276267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:42:57.289035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:57.289939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:57.291208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 527/1050] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:57.296472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.355947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 524/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:42:57.359708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.407516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566a7c4-8cc6-451b-9ea3-1aaf3473c727 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.415751 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.441842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.442454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.442734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.443017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.443940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.444049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.445528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.456889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 528/1052] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:57.457675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.458962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de87bc-2a33-4860-8f63-06821b345748 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.481744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.496953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.497586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.497864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.498136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.499243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.500695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.502607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 525/1053] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:57.503310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.559569 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35878527-030d-4b6c-b4d9-27ecbc006638 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.592292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.592905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.593183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.593453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] PATH_INFO: `/v3/services/image` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.594023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.595388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.600364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5517f-bd40-4b7e-bd76-b2e301ad88b6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:42:57.604478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:42:57.605442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:42:57.606272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 529/1054] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:42:57.607206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.625484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.636440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] RBAC: Adding query filter params (role.id=95fa066f81a84446b385ef8c145e555d, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.653284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.653764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 526/1055] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=95fa066f81a84446b385ef8c145e555d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:57.653764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.706976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:57.725041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6097a3-9a31-4a88-87ef-cc24dffcf799 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.762648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794523-31e4-43c0-a166-70cc09a3e09a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.763219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.763320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.763581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.763854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.764628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=a714874238ed4c2aa695f0147f7f8d11, user.id=74e319df21e64c5d9da5a77bccf3accf) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.764939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.766406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.784128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 530/1056] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/role_assignments?user.id=74e319df21e64c5d9da5a77bccf3accf&scope.project.id=a714874238ed4c2aa695f0147f7f8d11&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:57.815308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.815850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.816163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.816444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.817098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] RBAC: Adding query filter params (name=image) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.817407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.818808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.825745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 527/1057] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:42:57.833352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:57.946358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ceee7-55aa-4adc-9be0-83cbb95c353e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:57.983314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:57.983945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:57.984238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:57.984513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:57.985144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:42:57.985448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:57.986854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da997aa-e5e5-4608-8fa3-fcdcd5b843d8 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:57.991778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 531/1058] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:42:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:42:57.997788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:42:58.052519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:42:58.104900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adde862-d471-4060-8072-7210e2d1431a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:42:58.139076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:42:58.139697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:58.140009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:58.140289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:58.140969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:42:58.142339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085d84-f3f5-4a12-ad23-bb566c325bb0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:42:58.250852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 528/1059] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:42:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:42:59.767711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b9b5-9f32-4a09-b71c-5f10c38e0b41 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:59.768868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b9b5-9f32-4a09-b71c-5f10c38e0b41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:59.768868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95b9b5-9f32-4a09-b71c-5f10c38e0b41 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:59.770362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 532/1060] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:59.775223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b91e-d2ef-45db-8340-1278372979ae None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:59.775612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b91e-d2ef-45db-8340-1278372979ae None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:59.775806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7b91e-d2ef-45db-8340-1278372979ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:59.794090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-19b7b91e-d2ef-45db-8340-1278372979ae None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:59.795306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-19b7b91e-d2ef-45db-8340-1278372979ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:59.871217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 529/1061] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:42:59.920261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f087-b8a8-4009-aeae-bd7bc875fdbd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:59.920587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f087-b8a8-4009-aeae-bd7bc875fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:59.920824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398f087-b8a8-4009-aeae-bd7bc875fdbd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:59.922300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 533/1062] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:42:59.927808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:42:59.928135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:42:59.928409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:42:59.946306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:42:59.947500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:42:59.974863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.013922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 530/1063] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:00.134805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f087-b8a8-4009-aeae-bd7bc875fdbd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.150414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.239680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398f087-b8a8-4009-aeae-bd7bc875fdbd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.274772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.275748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.276311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.276591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.286825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.287631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:00.292761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:00.293700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:43:00.294549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:00.299200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 534/1064] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:00.300221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.379955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.396723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19baa9-e3fb-4248-a5ad-4a991b7e817b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.410199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cac808-0e4d-4be6-b944-6ee04ea756b2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.431127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.431761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.432066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.432332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.442529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:00.446189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.446797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.447119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-004940bf-363b-45d6-b922-c77701b71f50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:00.447300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:00.448263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:00.449106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:00.449749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.449749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:00.449749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.449937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 531/1065] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:43:00.449937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c7d7-7d7e-4646-8565-6f6318310c79 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.450067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043679ca-3bca-4e70-b843-91cdcfd5394e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.450144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c7d7-7d7e-4646-8565-6f6318310c79 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.450633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4c7d7-7d7e-4646-8565-6f6318310c79 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.452101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 532/1066] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:00.454224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4c7d7-7d7e-4646-8565-6f6318310c79 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.463425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 535/1067] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:00.464787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.465075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.465349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.481147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.482640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:00.483814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:00.549742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 536/1068] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:00.550566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.557504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4c7d7-7d7e-4646-8565-6f6318310c79 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.595803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.596466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.596750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.597190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.597672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:00.597976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.599335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.608042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 533/1069] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:00.613518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.621316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.666739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518b058-d4fb-45e0-8a72-82b30bddb154 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.705927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.706477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.706760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.706864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.707024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.717375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.718270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7888a44-a8b8-4e3b-b287-76604aaa56bf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.718815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:00.733679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:00.734632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:43:00.735542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:00.735542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:00.735542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:00.735542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 537/1070] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:00.740983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.755528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.756190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.756472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.756747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] PATH_INFO: `/v3/users/74e319df21e64c5d9da5a77bccf3accf` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.757993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] RBAC: Authorizing `identity:get_user(user_id=74e319df21e64c5d9da5a77bccf3accf)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.759414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.761038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 534/1071] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/users/74e319df21e64c5d9da5a77bccf3accf => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:00.766719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.842012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929935-4800-4e8c-8c96-b798cf417346 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.857580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.866502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b25a0a-7e34-4b03-ad5f-a4021ded4a5f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:00.874864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.875472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.875747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.876051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.876682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:00.876982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.878995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.892944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 538/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:00.893742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.905599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:00.906255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:00.906533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:00.906802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:00.907905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:00.909336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:00.916054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 535/1073] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:00.916054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:00.935656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:00.993525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e378c441-b88e-4ceb-bf8e-ec56242b8d17 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.009273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5ec27-c786-4d58-8865-229ac4483ba3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.027124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.027734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.028050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.028326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.042917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.043538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.043815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.044112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.052047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.053470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:43:01.064213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:01.065191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 536/1074] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:01.066633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.074025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.096726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.098177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.145724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.163455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbae672-08f9-4f62-91e4-d188041d803c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.194547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 539/1075] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:01.195305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.196414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.197078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.197470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.197740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11/users/74e319df21e64c5d9da5a77bccf3accf/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.199985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a714874238ed4c2aa695f0147f7f8d11, user_id=74e319df21e64c5d9da5a77bccf3accf, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.201436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.267291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.280665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 537/1076] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:43:01 2022] PUT /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11/users/74e319df21e64c5d9da5a77bccf3accf/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:43:01.281569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.291791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c45614-3626-4de9-90c7-b13d20ac02f2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.332133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.332771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.333055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.333328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.334078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:01.334385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.335882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.355626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 540/1077] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:01.362435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.403643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c35cf-96bf-46a0-8e1b-d00c65f3f6c7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.445080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.445638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.445919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.446194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.464344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.464344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.466493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:01.480718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:01.481807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:43:01.483186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:01.483186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:01.483186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:01.483186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 538/1078] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:01.487893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.489664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54987710-1fb6-4394-8bb1-22396a4e0845 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.527287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.527951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.528230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.528501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.531381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.541027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.542682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:01.558627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:01.559654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:43:01.560580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:01.560580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:01.560580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:01.568230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 541/1079] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:01.569064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.592759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ce834-1467-4742-b1c6-1c160994b703 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.627064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.627678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.627977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.628285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.628878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:01.629176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.630520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.643637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 539/1080] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:01.685849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e273573-b232-4b77-9332-e4efc02d76ea None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.724100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.724733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.725010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.725277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.725930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:01.726229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.727632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.745493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 542/1081] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:01.747041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.810537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:01.857336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9131-976a-41cd-8bd5-1f7b201f4660 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:01.896376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:01.897014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:01.897265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:01.897533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:01.904199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:01.905637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:43:01.917118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:01.918239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:01.919380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 540/1082] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:01.925926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:01.975629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:02.030595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a25c0-553b-46a4-8a89-afe1880ca03d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:02.062959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:02.063558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:02.063833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:02.064125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:02.065322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:02.065621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:02.067040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d89419-4ed7-489f-be51-96d94b2bdfe2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:02.078142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 543/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:02.085077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:02.183722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9590ad-8978-4d36-a482-ad4901e6917a None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:02.197711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:02.216966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:02.217606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:02.217882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:02.218152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/95fa066f81a84446b385ef8c145e555d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:02.220286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=7ea62ee4cea94e3f941b4301885469ba, role_id=95fa066f81a84446b385ef8c145e555d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:02.221732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3126-c969-49f2-be1d-d685cec7aa0b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:02.297502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 541/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:43:02 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/7ea62ee4cea94e3f941b4301885469ba/roles/95fa066f81a84446b385ef8c145e555d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:43:03.431813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2dcf-b7e8-462d-9021-4745c3d60d92 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:03.432380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2dcf-b7e8-462d-9021-4745c3d60d92 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:03.432490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2dcf-b7e8-462d-9021-4745c3d60d92 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:03.433807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 544/1085] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:03.439078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:03.439463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:03.440205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:03.458503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:03.459722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:03.525493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 542/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:03.795242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2dcf-b7e8-462d-9021-4745c3d60d92 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:03.899835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2dcf-b7e8-462d-9021-4745c3d60d92 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:03.906617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:03.933364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:03.933995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:03.934272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:03.934540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:03.945686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:03.950481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:03.956007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:03.957021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 545/1087] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:03.957969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.056813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eaa44-7592-4c29-8e39-f8efdceb92d0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.058973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:04.089363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.089966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.090244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.090513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.091166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:04.091468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:04.092856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:04.101156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 543/1088] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:04.107482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.203454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c6143-0879-477e-8b12-023fbd8cb228 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.235613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.236266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.237082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.237352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] PATH_INFO: `/v3/users/74e319df21e64c5d9da5a77bccf3accf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.238459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] RBAC: Authorizing `identity:get_user(user_id=74e319df21e64c5d9da5a77bccf3accf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:04.239942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f7d87-a670-4403-a5e7-c23b2e1f89ba None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:04.241510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 546/1089] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/users/74e319df21e64c5d9da5a77bccf3accf => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:04.247372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.372781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18b74e-d462-4765-a155-5ffbc2906cdf None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.404952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.405555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.405831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.406098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.439273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41d60-6f09-4dea-beb6-a24fc37f97cf None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.439810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41d60-6f09-4dea-beb6-a24fc37f97cf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.440028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a41d60-6f09-4dea-beb6-a24fc37f97cf None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.440274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:04.441649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 547/1090] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:43:04.446772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.447059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.449865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.465954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:04.467158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:04.475426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:04.476914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:04.494492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:04.536937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 548/1091] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:43:04.588484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 544/1092] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:04.594574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.691290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a171-6b6e-4f90-9ad2-d21e0d499aed None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.724773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.725396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.725669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.725941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.727049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:04.728522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:04.730136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 549/1093] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:04.736434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.798502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:04.802756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:04.833709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36647ad-3da5-4c6e-b3c9-cf2ad700eb04 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.836347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:04.867417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.868048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.868326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.868594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.869304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=a714874238ed4c2aa695f0147f7f8d11, user.id=74e319df21e64c5d9da5a77bccf3accf) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:04.869609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:04.871008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:04.876630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 545/1094] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/role_assignments?user.id=74e319df21e64c5d9da5a77bccf3accf&scope.project.id=a714874238ed4c2aa695f0147f7f8d11&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:04.906234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ab19-de7b-47ac-b5e4-ccedcc635b4f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:04.944408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:04.944963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:04.945239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:04.945506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:04.958069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:04.963483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:04.964733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:04.965799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 550/1095] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:43:04.970888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.076417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c4a0-2163-4ff6-bdd2-54a99ac3ddb9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.105117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:05.110474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.111084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.111401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.111672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.112429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:05.112759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.114084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.122026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 546/1096] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:43:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:05.128656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.216986 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:05.225338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4650752-3042-4669-9922-dc52a2ed6e9f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.259418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.261768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.261768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.261768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.270429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.271866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:05.286354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:05.287511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:43:05.289014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:05.289014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:05.289014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:05.289014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 551/1097] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:05.293440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.392135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253aa97-afea-4234-8ee7-96f5ac778c4f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.425603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.426216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.426500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.426774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.427413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:05.427717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.429111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.441106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 547/1098] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:05.446711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.546216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df727-eef4-47f8-ae79-202a5436acae None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.578641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.579269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.579549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.579821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.587967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.589412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:43:05.600847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:05.601822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:05.602821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 552/1099] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Sep 23 13:43:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:05.607735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.660179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:05.705881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21db65-9779-4b02-a80a-0243c5a2f841 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.739444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.740106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.740390 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.740670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.741391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:05.741700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.743115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.760357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 548/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Sep 23 13:43:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:05.766325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:05.770194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:05.867311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152808fc-f990-41b8-942b-00733dbc5a91 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:05.899219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:05.899820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:05.900127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:05.900402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:05.965382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:05.966812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:05.969305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:06.062187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 553/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:06.068010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:06.164945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c71de-79b0-455a-bca8-14783187be8d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:06.175562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:06.197707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:06.198340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:06.198624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:06.198897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:06.209664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:06.211109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:06.225836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:06.226952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:43:06.227838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:06.227838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:43:06.227838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:06.227838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 549/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:43:06.232721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:06.328330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ca2f0-b0ff-492d-b26a-e158a55c9007 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:06.331140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:06.361457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:06.362060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:06.362337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:06.362606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:06.363245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:06.363547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:06.364946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:06.375618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 554/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:06.381778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:06.482392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be3d111-4371-4b6e-ad78-6c2b52c9348f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:06.514994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:06.515623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:06.515906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:06.516202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:06.523320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:06.524780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:43:06.535885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:06.541990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:06.543086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 550/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:43:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:06.543615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:06.640147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f114024-0a4d-4b52-a06f-7cab5e69587f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:06.672949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:06.673554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:06.674368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:06.674640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:06.675321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:06.675625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:06.677086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81aeb5-5ef4-45fd-a8c1-4e779c207517 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:06.688777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 555/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:43:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:06.695479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:06.719478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:06.791071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221003e-f824-4318-8c3b-65e79ca7dcc6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:06.824129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:06.824722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:06.824998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:06.825266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:06.825978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] RBAC: Adding query filter params (role.id=95fa066f81a84446b385ef8c145e555d, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=7ea62ee4cea94e3f941b4301885469ba) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:06.826283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:06.827691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79164f-08de-4552-9289-d9d8c2b00f91 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:06.833346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 551/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:06 2022] GET /identity/v3/role_assignments?user.id=7ea62ee4cea94e3f941b4301885469ba&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=95fa066f81a84446b385ef8c145e555d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:07.058065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c909-9c2f-403f-bd5b-98f3d99dc3e0 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:07.058345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c909-9c2f-403f-bd5b-98f3d99dc3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:07.058620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1c909-9c2f-403f-bd5b-98f3d99dc3e0 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:07.060022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 556/1107] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:07.065298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:07.065588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:07.065865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:07.083983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:07.085175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:07.151616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 552/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:07.426769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1c909-9c2f-403f-bd5b-98f3d99dc3e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:07.451439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:07.529453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1c909-9c2f-403f-bd5b-98f3d99dc3e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:07.563370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:07.564027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:07.564306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:07.564612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:07.565729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:07.567160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230697b-aaed-4d62-b51e-7d749a481ab6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:07.568758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 557/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:07.574778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:07.592628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:07.675933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cbc0e-b6fb-4cd2-9bd3-32a72ef93b44 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:07.709796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:07.710335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:07.710615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:07.710883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:07.711525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:07.712996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822e00-b3ff-4106-891c-b678f42ad1da None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:07.794451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 553/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:43:07 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:09.951196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3572-8635-4f98-8e2f-267125ecaab7 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:09.951755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3572-8635-4f98-8e2f-267125ecaab7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:09.951755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc3572-8635-4f98-8e2f-267125ecaab7 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:09.953132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 558/1111] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:09.958883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:09.959324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:09.959430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:09.977498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:09.978669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:10.041888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 554/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:10.305240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3572-8635-4f98-8e2f-267125ecaab7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:10.396209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:10.405368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc3572-8635-4f98-8e2f-267125ecaab7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:10.438978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:10.440281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:10.440560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:10.440827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] PATH_INFO: `/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:10.442227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] RBAC: Authorizing `identity:get_role(role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:10.443576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:10.444938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 559/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:10 2022] GET /identity/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:10.450692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:10.452910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:10.546628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fdaf2-37e7-4bd5-9108-0d81abf001a9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:10.579475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:10.580098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:10.580379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:10.580651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] PATH_INFO: `/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:10.593000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ffbb1da23c734b56bb97bd3d9ddd686c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:10.594429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:10.596070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 555/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:10 2022] GET /identity/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:10.602195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:10.700457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795da5e-9df2-4a5e-9200-c44e30affbd1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:10.733520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:10.734127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:10.734407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:10.734678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:10.762415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:10.802785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:10.804248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:10.896686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 560/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:10.902663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:10.959802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:10.999971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fcd9a-3aff-45d8-859e-bd09d2bf09e0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:11.032379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:11.033531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:11.033825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:11.034100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:11.035211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:11.036662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba371fb-2b3d-4d20-a8f3-44415801aab3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:11.038270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 556/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:10 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:11.044789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:11.100884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:11.139763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6bf9b5-4383-4fa0-b575-928c92820d87 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:11.172473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:11.173024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:11.173305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:11.173579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:11.174860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=a714874238ed4c2aa695f0147f7f8d11, user.id=ffbb1da23c734b56bb97bd3d9ddd686c) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:11.175164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:11.176605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65418486-c56e-4633-b127-7b9e13965690 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:11.181911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 561/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:11 2022] GET /identity/v3/role_assignments?user.id=ffbb1da23c734b56bb97bd3d9ddd686c&scope.project.id=a714874238ed4c2aa695f0147f7f8d11&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:13.271431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb4e5-62d3-46cf-83dd-640085e216f9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:13.272016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb4e5-62d3-46cf-83dd-640085e216f9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:13.272016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb4e5-62d3-46cf-83dd-640085e216f9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:13.273355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 557/1118] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:13.278487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:13.278896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:13.279047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:13.297053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:13.298233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:13.361979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 562/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:13.631052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb4e5-62d3-46cf-83dd-640085e216f9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:13.728793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb4e5-62d3-46cf-83dd-640085e216f9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:13.754846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:13.762370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:13.762995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:13.763274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:13.763547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] PATH_INFO: `/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:13.764967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] RBAC: Authorizing `identity:get_role(role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:13.766319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:13.767641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 558/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:13 2022] GET /identity/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:13.773363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:13.826520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:13.869617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1f658-ac4f-4334-8d19-0e3d908c5dde None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:13.901814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:13.902380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:13.902661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:13.902935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] PATH_INFO: `/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:13.904072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ffbb1da23c734b56bb97bd3d9ddd686c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:13.905491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:13.907043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 563/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:13 2022] GET /identity/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:13.913218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:14.008176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53ad8c-28a2-4305-8eba-db20bf3f3a54 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:14.040339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:14.041216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:14.041497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:14.041767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:14.042868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:14.044303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77902706-e741-46ca-b6a2-ee01662e1b01 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:14.045891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 559/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:13 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:14.052208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:14.147097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8201e6-b294-43cf-86fe-a627e51bc7b1 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:14.169139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:14.180676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:14.181317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:14.181624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:14.181873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11/users/ffbb1da23c734b56bb97bd3d9ddd686c/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:14.184007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a714874238ed4c2aa695f0147f7f8d11, user_id=ffbb1da23c734b56bb97bd3d9ddd686c, role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:14.185443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc7d4c-fcfb-4f67-91e7-29d7dae4c1b0 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:14.240007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 564/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:43:14 2022] PUT /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11/users/ffbb1da23c734b56bb97bd3d9ddd686c/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:43:16.330276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f48-898f-464d-8ba1-1834157fb8c6 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:16.330831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f48-898f-464d-8ba1-1834157fb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:16.330831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d5f48-898f-464d-8ba1-1834157fb8c6 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:16.332776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 560/1124] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:16.338004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:16.338370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:16.338551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:16.356123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:16.357274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:16.420853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 565/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:16.684046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5f48-898f-464d-8ba1-1834157fb8c6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:16.745582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:16.781802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d5f48-898f-464d-8ba1-1834157fb8c6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:16.815009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:16.815623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:16.815903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:16.816207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] PATH_INFO: `/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:16.817577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] RBAC: Authorizing `identity:get_role(role_id=63d82f36fbbe4c029aa0d9d7161a3a40)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:16.818935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:16.820267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 561/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:16 2022] GET /identity/v3/roles/63d82f36fbbe4c029aa0d9d7161a3a40 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:16.825870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:16.919730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1358b-5f04-4c0c-b473-2f7e89fed027 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:16.932687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:16.953192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:16.953751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:16.954028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:16.954300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] PATH_INFO: `/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:16.955448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] RBAC: Authorizing `identity:get_user(user_id=ffbb1da23c734b56bb97bd3d9ddd686c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:16.956892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:16.958423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 566/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:16 2022] GET /identity/v3/users/ffbb1da23c734b56bb97bd3d9ddd686c => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:16.964001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:17.060308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754bbef-c86f-40aa-b255-8041d34a42ce None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:17.087671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:17.092274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:17.092874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:17.093153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:17.093425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:17.157284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:17.159234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:17.252398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 562/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:17.258182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:17.353051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40542ff-5ef2-4719-8199-8af3f9a9cee6 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:17.384721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:17.385335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:17.385610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:17.385878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] PATH_INFO: `/v3/projects/a714874238ed4c2aa695f0147f7f8d11` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:17.386970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] RBAC: Authorizing `identity:get_project(project_id=a714874238ed4c2aa695f0147f7f8d11)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:17.388420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3626a2-3cf5-43d5-94a1-5d5ae5320c61 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:17.390020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 567/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:17 2022] GET /identity/v3/projects/a714874238ed4c2aa695f0147f7f8d11 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:17.396503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:17.426428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:17.494080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163bd45a-87da-423f-8a32-b1aa2d682994 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:17.526497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:17.527042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:17.527321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:17.527594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:17.528335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] RBAC: Adding query filter params (role.id=63d82f36fbbe4c029aa0d9d7161a3a40, scope.project.id=a714874238ed4c2aa695f0147f7f8d11, user.id=ffbb1da23c734b56bb97bd3d9ddd686c) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:17.528644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:17.530058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3e773b-2a6e-4599-9cf8-1417c05e463d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:17.536193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 563/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:17 2022] GET /identity/v3/role_assignments?user.id=ffbb1da23c734b56bb97bd3d9ddd686c&scope.project.id=a714874238ed4c2aa695f0147f7f8d11&role.id=63d82f36fbbe4c029aa0d9d7161a3a40 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:19.683937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82a23-29d7-48d7-bff3-4572e1cfdee1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:19.684460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82a23-29d7-48d7-bff3-4572e1cfdee1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:19.684574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f82a23-29d7-48d7-bff3-4572e1cfdee1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:19.685875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 568/1131] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:19.691712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:19.692167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:19.692280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:19.709828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:19.710998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:19.773775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 564/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:20.045349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f82a23-29d7-48d7-bff3-4572e1cfdee1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:20.093807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:20.144244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f82a23-29d7-48d7-bff3-4572e1cfdee1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:20.177993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:20.178615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:20.178900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:20.179177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:20.180315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:20.181753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca0e3f-d072-4279-8d00-66ed50b14136 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:20.183295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 569/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:20.189034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:20.215398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:20.285199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5121-6889-4822-95e4-db9e0525afb6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:20.318719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:20.319257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:20.319538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:20.319805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:20.320471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:20.321881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d687471-a505-4cd1-858f-af4f3795fd89 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:20.440908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 565/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:43:20 2022] POST /identity/v3/projects => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:22.587593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916a-2f26-4a98-a39f-d30e4f3703ae None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:22.588150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916a-2f26-4a98-a39f-d30e4f3703ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:22.588150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06916a-2f26-4a98-a39f-d30e4f3703ae None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:22.589491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 570/1135] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:22.594653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:22.595085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:22.595219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:22.613513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:22.614703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:22.678995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 566/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 23 13:43:22.949003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06916a-2f26-4a98-a39f-d30e4f3703ae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:23.049455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06916a-2f26-4a98-a39f-d30e4f3703ae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:23.065477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:23.082164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:23.084115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:23.084115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:23.084115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:23.084486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:23.085919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb4646-aed3-4529-839d-2136621e9dcb None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:23.087466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 571/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:43:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:23.093186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:23.103539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:23.187443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3e4fd-9ec1-446d-8cf0-dba33e0d3d0e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:23.219387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:23.219944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:23.220822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:23.221095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:23.221730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:23.223181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b48919-83ed-47ed-b2e7-f92f3fd28583 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:23.297793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 567/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:43:23 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:25.503860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea559f5c-84bf-4ddc-ad4a-ba87548f5d99 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:25.504317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea559f5c-84bf-4ddc-ad4a-ba87548f5d99 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:25.504435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea559f5c-84bf-4ddc-ad4a-ba87548f5d99 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:25.505771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 572/1139] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:25.510897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:25.511269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:25.511450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:25.529076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:25.530260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:25.586123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:25.593986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 568/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:25.859238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea559f5c-84bf-4ddc-ad4a-ba87548f5d99 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:25.956789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea559f5c-84bf-4ddc-ad4a-ba87548f5d99 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:25.989383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:25.989990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:25.990266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:25.990529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.000105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:26.004874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:26.005945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:26.006948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 573/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:26.012045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:26.105888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe64fc-e2b6-4f54-b79b-349564e666b9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:26.137850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:26.138379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:26.138654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:26.138921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.139571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:26.139869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:26.141236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:26.148833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 569/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:26.154519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:26.199235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:26.250332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bdea6-1861-4dc0-8570-ec0e88684f2a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:26.283356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:26.284043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:26.284327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:26.284605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] PATH_INFO: `/v3/users/2fc315ab93714b49b27ae15c9ea34c8b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.323212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] RBAC: Authorizing `identity:get_user(user_id=2fc315ab93714b49b27ae15c9ea34c8b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:26.324681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:26.326263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 574/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:26 2022] GET /identity/v3/users/2fc315ab93714b49b27ae15c9ea34c8b => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:26.332492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:26.385991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:26.429185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d50f-25e7-41a2-a7c1-a43a34e33f2e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:26.463349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:26.463349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:26.463349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:26.463349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.527822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:26.529293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:26.582632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:26.624296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 570/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:26.630685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:26.726342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67888024-5a1e-4b8f-98fb-4ef4c9b7db6a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:26.727831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:26.760591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:26.761220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:26.761501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:26.761776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] PATH_INFO: `/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.762891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] RBAC: Authorizing `identity:get_project(project_id=08f3934ca1f94ac7a16ad7185fa3df6c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:26.764365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738dde44-94b7-45f4-9ab4-38a5eec4fe21 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:26.765998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 575/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:26 2022] GET /identity/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:26.772661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:26.865928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2190d93-f582-49d0-9aaf-da03be13786d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:26.898643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:26.899232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:26.899507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:26.899775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:26.900515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=08f3934ca1f94ac7a16ad7185fa3df6c, user.id=2fc315ab93714b49b27ae15c9ea34c8b) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:26.900819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:26.902223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af2d0a-1a0f-462b-9a73-7c0dd87b7fcb None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:26.907404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 571/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:26 2022] GET /identity/v3/role_assignments?user.id=2fc315ab93714b49b27ae15c9ea34c8b&scope.project.id=08f3934ca1f94ac7a16ad7185fa3df6c&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:28.999382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0287-b739-4d69-87ec-20b0367b9ac1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:28.999908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0287-b739-4d69-87ec-20b0367b9ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:28.999908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0287-b739-4d69-87ec-20b0367b9ac1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.001294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 576/1147] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:29.006300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:29.006720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:29.006859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.024599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:29.025791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:29.039827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:29.091157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 572/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:29.355770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0287-b739-4d69-87ec-20b0367b9ac1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:29.451969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0287-b739-4d69-87ec-20b0367b9ac1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:29.486417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:29.487046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:29.487324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:29.487596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.497368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:29.502236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:29.503406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:29.504600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 577/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:29.509282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:29.604558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570d532-6d20-49dd-8fd4-968f18680dcd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:29.637010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:29.637548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:29.637828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:29.638103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.638761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:29.639067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:29.640460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:29.648833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 573/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:29.654393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:29.684068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:29.750274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d711b-4376-438b-8537-a43ac0e7294d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:29.783871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:29.784512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:29.784792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:29.785061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] PATH_INFO: `/v3/users/2fc315ab93714b49b27ae15c9ea34c8b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.786164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc315ab93714b49b27ae15c9ea34c8b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:29.787578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:29.789153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 578/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:29 2022] GET /identity/v3/users/2fc315ab93714b49b27ae15c9ea34c8b => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:29.795001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:29.809747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:29.891762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c29a6-2bd6-4dfa-bb7a-42a8434b099d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:29.924885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:29.925502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:29.925786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:29.926061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] PATH_INFO: `/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:29.927162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] RBAC: Authorizing `identity:get_project(project_id=08f3934ca1f94ac7a16ad7185fa3df6c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:29.928614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5718a7-b966-4834-8552-608d06913f03 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:29.930226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 574/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:29 2022] GET /identity/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:43:29.935987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:30.027900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:30.031584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d18e5-cf9b-4e0e-b03d-d7cf4e3f81b2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:30.065027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:30.065669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:30.065947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:30.066218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] PATH_INFO: `/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c/users/2fc315ab93714b49b27ae15c9ea34c8b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:30.068123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] RBAC: Authorizing `identity:create_grant(project_id=08f3934ca1f94ac7a16ad7185fa3df6c, user_id=2fc315ab93714b49b27ae15c9ea34c8b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:30.069536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838103bd-4002-4af0-b3d9-c15739369a2a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:30.176845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 579/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:43:29 2022] PUT /identity/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c/users/2fc315ab93714b49b27ae15c9ea34c8b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:43:32.267907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3702-4a08-4927-bffc-7c3d9011b955 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:32.268482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3702-4a08-4927-bffc-7c3d9011b955 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:32.268482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d3702-4a08-4927-bffc-7c3d9011b955 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:32.269824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 575/1154] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:32.275135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:32.275556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:32.275684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:32.294478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:32.295668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:32.361552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 580/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:32.632558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3702-4a08-4927-bffc-7c3d9011b955 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:32.712046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:32.731236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d3702-4a08-4927-bffc-7c3d9011b955 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:32.764840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:32.765459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:32.765738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:32.766010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:32.776396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:32.781116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:32.782206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:32.783305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 576/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:32.788319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:32.871437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:32.883652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa65552-82c7-4bba-a22c-5fd27258cf92 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:32.917118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:32.917746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:32.918027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:32.918299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:32.918971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:32.919454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:32.921540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:32.929869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 581/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:32.935664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:33.030923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65852083-4972-41ee-8766-f30b3e3e182f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:33.063374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:33.064598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:33.064877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:33.065146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] PATH_INFO: `/v3/users/2fc315ab93714b49b27ae15c9ea34c8b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:33.066250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=2fc315ab93714b49b27ae15c9ea34c8b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:33.067668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:33.069232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 577/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:32 2022] GET /identity/v3/users/2fc315ab93714b49b27ae15c9ea34c8b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:33.074780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:33.171476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc065f-ced8-44e0-a9d3-987c7ac1003a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:33.204821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:33.205416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:33.205700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:33.205976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:33.223684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:33.272478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:33.273901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:33.366936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 582/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:33.372833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:33.383711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:33.470391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a65420-611e-470d-93cf-4af59e8ac5d9 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:33.503740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:33.504399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:33.504683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:33.504957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] PATH_INFO: `/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:33.506063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] RBAC: Authorizing `identity:get_project(project_id=08f3934ca1f94ac7a16ad7185fa3df6c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:33.507481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f493e7-1e4e-4519-a519-8945eebe703b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:33.509133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 578/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:33 2022] GET /identity/v3/projects/08f3934ca1f94ac7a16ad7185fa3df6c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:33.515178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:33.563328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:33.611626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230828b-9862-4e2c-a348-23147ca4ee10 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:33.644121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:33.644718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:33.644998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:33.645267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:33.645980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=08f3934ca1f94ac7a16ad7185fa3df6c, user.id=2fc315ab93714b49b27ae15c9ea34c8b) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:33.646287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:33.647693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f692f-3952-4e06-8d0c-9759f2659afa None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:33.653300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 583/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:33 2022] GET /identity/v3/role_assignments?user.id=2fc315ab93714b49b27ae15c9ea34c8b&scope.project.id=08f3934ca1f94ac7a16ad7185fa3df6c&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:35.824827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140eac0-493c-4c33-aed6-dad911b85a63 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:35.825413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140eac0-493c-4c33-aed6-dad911b85a63 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:35.825413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140eac0-493c-4c33-aed6-dad911b85a63 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:35.826704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 579/1162] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:35.832748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:35.833185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:35.833312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:35.851031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:35.852252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:35.916567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 584/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:36.191280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140eac0-493c-4c33-aed6-dad911b85a63 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:36.266374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:36.289109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140eac0-493c-4c33-aed6-dad911b85a63 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:36.322265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:36.322866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:36.323147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:36.323453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:36.387502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:36.388977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:36.460496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:36.483733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 580/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:36.490138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:36.533558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:36.585791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65b072-7c6b-4341-bc1d-9cdf9b2a0c4e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:36.619005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:36.619633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:36.619938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:36.620217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:36.626617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:36.628094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-20f0e6a4-ee2a-453b-a06a-a414330cf4ab None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:36.639285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:36.640581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:36.641680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 585/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:43:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:36.646392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:36.742538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345de449-1333-4ec9-8da7-45b78c856843 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:36.775465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:36.776094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:36.776378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:36.776649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:36.777277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:36.777576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:36.778932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1b8e-966c-4efb-b58e-d06d817439b8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:36.786396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 581/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Sep 23 13:43:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:38.885729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88c5b-a457-4c85-b88a-48de68161a8a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:38.886296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88c5b-a457-4c85-b88a-48de68161a8a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:38.886296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88c5b-a457-4c85-b88a-48de68161a8a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:38.887622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 586/1167] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:38.892901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d446-c999-42fb-b6e2-bc0fc1b73e9c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:38.893324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d446-c999-42fb-b6e2-bc0fc1b73e9c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:38.893446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d446-c999-42fb-b6e2-bc0fc1b73e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:38.911555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4735d446-c999-42fb-b6e2-bc0fc1b73e9c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:38.912772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4735d446-c999-42fb-b6e2-bc0fc1b73e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:38.945732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:38.977545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 582/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:39.241789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88c5b-a457-4c85-b88a-48de68161a8a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:39.342606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88c5b-a457-4c85-b88a-48de68161a8a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:39.345022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:39.377083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:39.377838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:39.378429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:39.378707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:39.379382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:39.380779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc9403-0b03-4d7f-84e0-f08a3cf69652 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:39.440861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 587/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Fri Sep 23 13:43:39 2022] POST /identity/v3/domains => generated 267 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:41.591822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeeb0-cdf1-40bf-8c29-7d701757eb84 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:41.592373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeeb0-cdf1-40bf-8c29-7d701757eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:41.592481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbeeb0-cdf1-40bf-8c29-7d701757eb84 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:41.593753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 583/1170] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:41.599493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:41.599946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:41.600077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:41.618419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:41.619610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:41.684331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 588/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:41.951826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbeeb0-cdf1-40bf-8c29-7d701757eb84 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:42.050371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbeeb0-cdf1-40bf-8c29-7d701757eb84 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:42.082804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:42.083413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:42.083693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:42.083990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] PATH_INFO: `/v3/domains/6714bfc96da04e3696be0d268fdf71de` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:42.093903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=6714bfc96da04e3696be0d268fdf71de)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:42.095960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524d308-7576-47fd-843f-eab3e907ba0f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:42.097517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 584/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Sep 23 13:43:41 2022] GET /identity/v3/domains/6714bfc96da04e3696be0d268fdf71de => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:42.103332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:42.192875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:42.199311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df8357-9374-4b9d-8532-e81eb752079e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:42.233229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:42.233822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:42.234104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:42.234378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:42.235020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:42.236561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee0abc-fd31-47d0-ad15-e425df71b9fd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:42.303329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 589/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:43:42 2022] POST /identity/v3/projects => generated 361 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:44.440968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfed-ae45-4487-995f-a4c7cb92ffce None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:44.441497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfed-ae45-4487-995f-a4c7cb92ffce None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:44.441497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7dfed-ae45-4487-995f-a4c7cb92ffce None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:44.442846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 585/1174] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:44.448102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:44.448525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:44.448658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:44.466608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:44.467794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:44.531910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 590/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:44.799187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dfed-ae45-4487-995f-a4c7cb92ffce None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:44.830061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:44.898155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7dfed-ae45-4487-995f-a4c7cb92ffce None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:44.930423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:44.931043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:44.931325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:44.931600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] PATH_INFO: `/v3/domains/6714bfc96da04e3696be0d268fdf71de` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:44.932740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=6714bfc96da04e3696be0d268fdf71de)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:44.934162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c0c16-0b70-485c-9512-44401ead2a7f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:44.935713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 586/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Sep 23 13:43:44 2022] GET /identity/v3/domains/6714bfc96da04e3696be0d268fdf71de => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:44.941938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:45.014072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:45.035282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c38f64-f927-4c65-8e1e-10a27c88ebb8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:45.068720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:45.069257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:45.069533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:45.069803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:45.070449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:45.071863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9ef24-ba81-40d1-a4e7-e1bb1b351928 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:45.148234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 591/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:43:44 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:43:47.318333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b1e2-f9c9-4a8d-bbee-9b3e0cdff2ab None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:47.318891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b1e2-f9c9-4a8d-bbee-9b3e0cdff2ab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:47.318891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b1e2-f9c9-4a8d-bbee-9b3e0cdff2ab None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:47.320245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 587/1178] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:47.325511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:47.325921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:47.326077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:47.344395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:47.346139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:47.410207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 592/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:47.676796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b1e2-f9c9-4a8d-bbee-9b3e0cdff2ab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:47.770306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:47.774673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b1e2-f9c9-4a8d-bbee-9b3e0cdff2ab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:47.806258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:47.806875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:47.807156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:47.807430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:47.817595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:47.822838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:47.824052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:47.825087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 588/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:43:47.830772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:47.888767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:47.926316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce5f8-feda-4f72-9dd1-337525905293 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:47.959431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:47.960001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:47.960283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:47.960555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:47.961209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:47.961510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:47.962874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:47.970504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 593/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:47.976282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:48.072993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebfeed-f048-4c5d-a013-1837b9f0b28e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:48.104421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:48.105033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:48.105314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:48.105587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] PATH_INFO: `/v3/users/745e3ba3d6c4403f97741a363c6a727e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:48.119118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] RBAC: Authorizing `identity:get_user(user_id=745e3ba3d6c4403f97741a363c6a727e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:48.120581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:48.122141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 589/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:47 2022] GET /identity/v3/users/745e3ba3d6c4403f97741a363c6a727e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:48.128584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:48.224475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc42e6b-d7bf-4d6d-b1cb-4a94a211c04c None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:48.246755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:48.257616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:48.258217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:48.259217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:48.259217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:48.323843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:48.325298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:48.418037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 594/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:48.424716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:48.442266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:48.521301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8582b1-22b5-4838-9029-19c5a1d5f66c None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:48.558555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:48.559175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:48.559455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:48.559727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] PATH_INFO: `/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:48.560846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] RBAC: Authorizing `identity:get_project(project_id=d22f56352fd24eeebb57a1c4e2e9405e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:48.562266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd4d13-6195-4b58-985d-27452b19e71e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:48.563956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 590/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:48 2022] GET /identity/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:48.569973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:48.593533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:48.666157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee109d-e169-49da-894c-f1467c4f7f9a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:48.698696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:48.699292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:48.699571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:48.699844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:48.700599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=d22f56352fd24eeebb57a1c4e2e9405e, user.id=745e3ba3d6c4403f97741a363c6a727e) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:48.700914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:48.702330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aac8b-7320-4b01-bbfc-fc5028b322de None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:48.708058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 595/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:48 2022] GET /identity/v3/role_assignments?user.id=745e3ba3d6c4403f97741a363c6a727e&scope.project.id=d22f56352fd24eeebb57a1c4e2e9405e&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:50.784524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241770d6-51bb-4217-a2a2-f29c0007ded9 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:50.785045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241770d6-51bb-4217-a2a2-f29c0007ded9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:50.785045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241770d6-51bb-4217-a2a2-f29c0007ded9 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:50.786395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 591/1186] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:50.791939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:50.792314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:50.792501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:50.810329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:50.811514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:50.876296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 596/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:51.143848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241770d6-51bb-4217-a2a2-f29c0007ded9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:51.223772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:51.239625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241770d6-51bb-4217-a2a2-f29c0007ded9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:51.272045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:51.272661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:51.272936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:51.273207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:51.284441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:51.289145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:51.290222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:43:51.291729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 592/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:51.296394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:51.314764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:51.392919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1befc0-b385-4f73-95cc-499797b1eb7f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:51.427461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:51.428027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:51.428311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:51.428585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:51.429244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:51.429552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:51.430922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:51.438730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 597/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:51.444552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:51.541744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad4da2-60d3-4d16-ac4f-7e83064f415d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:51.573588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:51.574200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:51.574478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:51.574747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] PATH_INFO: `/v3/users/745e3ba3d6c4403f97741a363c6a727e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:51.575834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] RBAC: Authorizing `identity:get_user(user_id=745e3ba3d6c4403f97741a363c6a727e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:51.577283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:51.578822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 593/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:51 2022] GET /identity/v3/users/745e3ba3d6c4403f97741a363c6a727e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:51.584554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:51.662762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:51.681698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2bac52-f1af-43e1-996e-ea81e3e43204 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:51.714403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:51.715025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:51.715303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:51.715575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] PATH_INFO: `/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:51.716713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] RBAC: Authorizing `identity:get_project(project_id=d22f56352fd24eeebb57a1c4e2e9405e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:51.718168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b536bf3-99c8-4317-8884-8f683f8b621b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:51.720432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 598/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:51 2022] GET /identity/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:51.726316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:51.741026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:51.821426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3d316-8711-4db6-ad45-5dd0d6c4dace None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:51.853738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:51.854382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:51.854663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:51.854938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] PATH_INFO: `/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e/users/745e3ba3d6c4403f97741a363c6a727e/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:51.856871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d22f56352fd24eeebb57a1c4e2e9405e, user_id=745e3ba3d6c4403f97741a363c6a727e, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:51.858321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3766a5-e898-4b4a-a57d-af023bbad8c5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:51.907941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 594/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:43:51 2022] PUT /identity/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e/users/745e3ba3d6c4403f97741a363c6a727e/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:43:54.005097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a00f5-0645-4661-be4a-7c6204dfbc96 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.005658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a00f5-0645-4661-be4a-7c6204dfbc96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.005658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a00f5-0645-4661-be4a-7c6204dfbc96 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:54.006998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 599/1193] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:43:54.012253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.012637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.012809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:54.031229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:43:54.032476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:43:54.096703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 595/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:43:54.368350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a00f5-0645-4661-be4a-7c6204dfbc96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:54.469048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a00f5-0645-4661-be4a-7c6204dfbc96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:54.501659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:54.502277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.502553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.502823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:54.512828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:43:54.517591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:43:54.518659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:43:54.519532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 600/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:43:54.524631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:54.526850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:54.620892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b39fe8-008c-4f06-83d8-1f985aac4876 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:54.653242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:54.653836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.654113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.654384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:54.655034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:54.655336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:54.657193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:54.664839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 596/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:54.670830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:54.682296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:54.768031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2e944-b09a-45d3-971f-ff4360e3668d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:54.800407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:54.801025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.801304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.801578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] PATH_INFO: `/v3/users/745e3ba3d6c4403f97741a363c6a727e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:54.802687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] RBAC: Authorizing `identity:get_user(user_id=745e3ba3d6c4403f97741a363c6a727e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:54.804140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:54.805699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 601/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Sep 23 13:43:54 2022] GET /identity/v3/users/745e3ba3d6c4403f97741a363c6a727e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:54.811275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:54.871131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:54.908595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82de41-62f8-467b-b12e-6fccb322ac31 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:54.940305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:54.940901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:54.941184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:54.941460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:55.005260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:55.006712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:55.065394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:55.102482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 597/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:43:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:43:55.108379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:55.182267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:43:55.204631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63595467-bb82-4545-b2c6-7662ab93fe05 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:55.236917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:55.237540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:55.237825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:55.238101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] PATH_INFO: `/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:55.239214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] RBAC: Authorizing `identity:get_project(project_id=d22f56352fd24eeebb57a1c4e2e9405e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:55.240678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e9ea1-a119-4b76-939d-709583c6859a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:55.242289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 602/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Sep 23 13:43:55 2022] GET /identity/v3/projects/d22f56352fd24eeebb57a1c4e2e9405e => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:43:55.248206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:43:55.344306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dbad8-5133-4fe9-9ee3-5e2b8c37dc54 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:43:55.376689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:43:55.377282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:43:55.377555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:43:55.377822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:43:55.378534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=d22f56352fd24eeebb57a1c4e2e9405e, user.id=745e3ba3d6c4403f97741a363c6a727e) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:43:55.378838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:43:55.380391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356698bf-d715-4cce-b215-9e6df1e4653e None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:43:55.389055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 598/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:43:55 2022] GET /identity/v3/role_assignments?user.id=745e3ba3d6c4403f97741a363c6a727e&scope.project.id=d22f56352fd24eeebb57a1c4e2e9405e&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:44:05.232759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=28 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:44:05.385109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=86 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:06.156976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6783-9fd7-4947-8d80-93b86c70de5d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:06.157577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6783-9fd7-4947-8d80-93b86c70de5d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:06.157577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d6783-9fd7-4947-8d80-93b86c70de5d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:06.158877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 603/1201] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:06.164668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:06.165118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:06.165215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:06.183605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:06.184833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:06.249203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 599/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:06.518557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6783-9fd7-4947-8d80-93b86c70de5d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:06.618108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d6783-9fd7-4947-8d80-93b86c70de5d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:06.650533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:06.651153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:06.651434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:06.651702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:06.661255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:06.662688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:06.677955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:06.679161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:06.680456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:06.680456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:06.680456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:06.680456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 604/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:06.685324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:06.783298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d7e1b-00bb-4c74-8915-45ce1f607d9e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:06.815668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:06.821863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:06.822478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:06.822759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:06.823034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:06.823677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:06.824019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:06.825433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcfe7e-9ac6-46c4-a284-bc65eb315f5a None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:06.837157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 600/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:06.842856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:06.894311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:06.940145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9b816-42c1-4473-b7bf-a1cd62ff29c9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:06.973074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:06.973681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:06.973960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:06.974231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:06.974865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:06.976323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fd54a-c1d1-43a4-aea2-741b66f32e87 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:07.048368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 605/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Sep 23 13:45:06 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:45:09.238763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae577e-3fdd-483c-a06b-cad8078e4697 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:09.239352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae577e-3fdd-483c-a06b-cad8078e4697 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:09.239352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae577e-3fdd-483c-a06b-cad8078e4697 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:09.240693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 601/1206] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:09.246677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:09.247080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:09.247229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:09.266453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:09.267669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:09.333801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 606/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:09.605822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae577e-3fdd-483c-a06b-cad8078e4697 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:09.706706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae577e-3fdd-483c-a06b-cad8078e4697 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:09.740244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:09.740864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:09.741139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:09.741408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:09.751535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:09.756288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:09.762322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:09.763268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 602/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:45:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:09.764058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:09.801580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:09.859079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c58396-04c5-4b97-a31d-096d741adffd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:09.891794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:09.892424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:09.892735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:09.893005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:09.893658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:09.893957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:09.895327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:09.903483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 607/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:45:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:09.910535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:09.959031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:10.005859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b935d13-3517-4352-a791-18196f61e6f6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.038214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.038829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.039153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.039423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.049811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.051311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:10.065825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:10.071179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:10.072156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:10.072156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:10.072156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:10.072156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 603/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:45:10.073206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:10.167663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:10.170238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15000ab9-d719-421a-814b-6e5b5d5e1d7e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.202994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.203596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.203875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.204179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.204813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:10.205114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.206473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.217100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 608/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:10.222838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:10.322225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f03b2-72ad-44fc-ac3f-0de1930f6627 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.323750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:10.354182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.354807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.357400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.357400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.362384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.363813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:10.375074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:10.376321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:10.377295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 604/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:10.381973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:10.480112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ec911-0c26-40d5-bf2e-d4611076db71 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.513514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.514122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.514408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.514684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.515407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:10.515715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.517194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.533729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 609/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:10.540238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:10.637680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ef99b-a0b0-44b8-a5d3-ebf30da80109 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.669839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.670421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.670702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.670974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.699508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:10.735503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.736959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.832833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 605/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:45:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:45:10.838693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:10.857432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:10.934280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51e48a-1010-483e-b604-f860dcc8fd81 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:10.967993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:10.968622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:10.968895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:10.969165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:10.979253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:10.980717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:10.997115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:10.998212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:10.999301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:10.999301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:10.999301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:10.999301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 610/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:11.002153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:11.061362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:11.099353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bb3da-d58a-4adf-8451-cdf95cbf2f2f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:11.131548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:11.132172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:11.132449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:11.132742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:11.133369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:11.133667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:11.135014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:11.146992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 606/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:11.153215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:11.221222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:11.251466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b3e4-9f14-4b40-8ee8-692a4fe011e2 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:11.283821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:11.284555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:11.284839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:11.285111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:11.292442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:11.293947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:11.305731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:11.306797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:11.308084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 611/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:11.312795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:11.411155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332796c-8da3-4a3b-9a3f-30812d608477 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:11.432707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:11.444150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:11.444764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:11.445048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:11.445820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:11.446513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:11.446853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:11.448299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e339758-ab81-4f7d-8f32-ef00ca7daaf2 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:11.459832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 607/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:11.466919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:11.564354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109087a-7911-49e6-8923-53892f40bb9f None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:11.593153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:11.598822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:11.599427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:11.599713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:11.600011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:11.600725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=4590313e50ef4de6b2d6a54467b13a12) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:11.601033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:11.602481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c4b802-77b3-4f6c-9bde-cb8b99b26fec None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:11.607816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 612/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:45:11 2022] GET /identity/v3/role_assignments?user.id=4590313e50ef4de6b2d6a54467b13a12&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:13.789072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb3c29-53a1-4767-a323-d69996315668 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:13.789624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb3c29-53a1-4767-a323-d69996315668 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:13.789624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb3c29-53a1-4767-a323-d69996315668 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:13.791206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 608/1220] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:13.796460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:13.796834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:13.797125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:13.815447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:13.816665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:13.882429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 613/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:14.158928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb3c29-53a1-4767-a323-d69996315668 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.257635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb3c29-53a1-4767-a323-d69996315668 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:14.291458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:14.292099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:14.292377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:14.292646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:14.302512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:14.307283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:14.308426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:14.309616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 609/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:14.314383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.412394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684b3d1-c44a-486b-a5a9-b937f0a766eb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:14.435473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:14.446310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:14.446977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:14.447263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:14.447537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:14.448228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:14.448532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:14.449905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:14.457729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 614/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:14.464542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.507189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:14.561221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2db17-daf2-4ae7-9e38-adc2f78a4d1e None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:14.595110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:14.595731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:14.596036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:14.596307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:14.605970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:14.607395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:14.622065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:14.623194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:14.624534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:14.624534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:14.624534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:14.624534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 610/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:14.628893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.728671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4b6d7-6f15-43b7-a0d8-7c1ec00426b7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:14.762509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:14.765720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:14.765720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:14.765720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:14.765720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:14.765720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:14.766126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:14.778231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 615/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:14.784029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.875338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:14.881830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91d205-5403-4fea-9fe3-3f5595694e71 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:14.913999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:14.914620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:14.914901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:14.915174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:14.922665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:14.924137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:14.935641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:14.936787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:14.937740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 611/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:14.942770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:14.988692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:15.041614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8fffc-96fb-42b6-98db-8182d561ea3a None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.075438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.076073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.076357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.076630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.077353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:15.077657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.079078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.095770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 616/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:15.101794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:15.200919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58083-fcae-47f4-a770-324c76ac0055 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.233713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.234339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.234628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.234926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.245911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.247332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:15.261203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:15.266242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:15.267348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:15.267348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:15.267348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:15.267348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 612/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:15.268875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:15.365540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead5405-5f3c-49f2-b413-26725c689621 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.368523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:15.398828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.399427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.399709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.400009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.400645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:15.400958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.402320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.413458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 617/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:15.420045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:15.429271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:15.517430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290b19f-f2d9-44d2-8483-4082b2331e18 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.551402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.552056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.552338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.552606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.559061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.560556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:15.571830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:15.575107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:15.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 613/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:15.578949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:15.677268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e942e23-7397-4747-83c9-64df051341bd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.709278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.711155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.711155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.711155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.711564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:15.711871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.713322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150da09-6a97-46ea-b798-96e17521257b None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.724723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 618/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:15.731367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:15.796886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:15.830041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d84a0c-c14c-4c73-a3d5-8ee26966bdc7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:15.862859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:15.863514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:15.863797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:15.864101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/4590313e50ef4de6b2d6a54467b13a12/roles/9357a9a551314a82bc4340214fccad24` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:15.878736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=4590313e50ef4de6b2d6a54467b13a12, role_id=9357a9a551314a82bc4340214fccad24)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:15.880257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c04d4e-a8ef-4fa5-812f-74fa3592712c None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:15.958899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 614/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:45:15 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/4590313e50ef4de6b2d6a54467b13a12/roles/9357a9a551314a82bc4340214fccad24 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:45:18.080640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25223-80ee-49ab-844f-7b71311824b2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:18.081210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25223-80ee-49ab-844f-7b71311824b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:18.081210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b25223-80ee-49ab-844f-7b71311824b2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:18.082752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 619/1233] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:18.088076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:18.088479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:18.088635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:18.107241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:18.108466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:18.173716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 615/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:18.446046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b25223-80ee-49ab-844f-7b71311824b2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:18.471761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:18.547639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b25223-80ee-49ab-844f-7b71311824b2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:18.580108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:18.580785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:18.581013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:18.581284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:18.591527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:18.596414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:18.597399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:18.598328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 620/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Sep 23 13:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:18.604436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:18.649311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:18.701002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a56ec7-8664-4563-bfa1-b259196f9a1b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:18.733760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:18.734358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:18.734634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:18.734903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:18.735553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] RBAC: Adding query filter params (name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:18.735850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:18.737224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:18.745084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 616/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Sep 23 13:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:18.750693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:18.836902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:18.852226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fcf987-dcc6-48bf-8d5d-897a9c4a8370 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:18.884949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:18.885571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:18.885856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:18.886130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:18.895791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:18.897265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:18.911767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:18.912763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:18.913700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:18.913700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:18.913700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:18.913700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 621/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:18.918952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.019064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f4f338-f1b2-4d36-ac01-a2c326bc873b None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.028753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:19.052721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:19.053318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:19.053594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:19.053861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:19.054550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:19.054847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:19.056228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:19.067563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 617/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:19.074063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.171157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e6c8d-1c95-4ccc-a04c-98ddacc9ff94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.204231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:19.204851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:19.205129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:19.205418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:19.208036 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:19.212972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:19.214410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:19.225247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:19.226934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:19.228197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 622/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:19.232593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.333107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4580d8-1402-4fd1-987c-4170a3040a5d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.365968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:19.366574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:19.367363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:19.367633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:19.368427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:19.368730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:19.370143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:19.387565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 618/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:19.393362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.492547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a615a0-d457-4aeb-84e3-d1cd3f9c6350 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.524906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:19.525485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:19.525760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:19.526029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:19.585449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:19.591799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:19.593273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:19.689428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 623/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:45:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:45:19.695457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.729179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:19.799062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85acb5-4b4f-4621-9e7f-946c106984c3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.833465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:19.834119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:19.834397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:19.834696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:19.846105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:19.847480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:19.862156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:19.863300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:19.864594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:19.864594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:19.864594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:19.864594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 619/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:19.869564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:19.959350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:19.965600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947bc6b-2eac-4d6f-bc3b-43f145d73bdc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:19.999777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:20.000406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:20.000682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:20.000949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:20.001575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:20.001870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:20.003221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:20.013820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 624/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:20.019588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:20.096008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:20.116918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac15d51-e67e-43a9-b9c0-c6810def2d36 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:20.148718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:20.149333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:20.149612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:20.149880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:20.156227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:20.157660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:20.169413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:20.170499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:20.171605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 620/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:20.176437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:20.276116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3dd99-570f-4f40-9042-47da4aeac9f3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:20.310301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:20.310901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:20.311176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:20.311441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:20.312192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:20.317939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:20.317939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c97-d807-4a85-8088-ec9653405265 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:20.326185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 625/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:20.332597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:20.431892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a455b9-8824-4df0-a39d-59ae59c38777 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:20.465704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:20.466472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:20.466574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:20.466846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:20.467571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] RBAC: Adding query filter params (role.id=9357a9a551314a82bc4340214fccad24, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=4590313e50ef4de6b2d6a54467b13a12) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:20.467881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:20.469331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d74c95-400d-4fda-8625-4fa51706b604 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:20.475049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 621/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:45:20 2022] GET /identity/v3/role_assignments?user.id=4590313e50ef4de6b2d6a54467b13a12&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=9357a9a551314a82bc4340214fccad24 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:22.647417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74abc-13a9-4118-9828-0a92924f493f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:22.647417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74abc-13a9-4118-9828-0a92924f493f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:22.647417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74abc-13a9-4118-9828-0a92924f493f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:22.647417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 626/1247] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:22.653630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:22.654052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:22.654180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:22.660623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:22.673519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:22.674740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:22.743190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 622/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:23.011431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d74abc-13a9-4118-9828-0a92924f493f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.029533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:23.111063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d74abc-13a9-4118-9828-0a92924f493f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.146213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.146840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.147124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.147399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.157494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:23.162322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:23.163261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:23.164214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 627/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:23.169720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.265633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83390ef8-c5f5-4a43-be1b-bf5d35b95a0b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.293940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:23.298664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.299275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.299553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.299827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.300512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:23.300818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:23.302186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:23.310485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 623/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:23.316359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.391352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:23.413027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327968a9-489a-4861-90c7-ccfcd08a18f7 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.446459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.447114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.447372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.447647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.457454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:23.458933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:23.474017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:23.481027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:23.482164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:23.482164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:23.482164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:23.482164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 628/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:23.482456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.579988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f75f9-ba71-40cd-80ab-d0d0bceda93d None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.612482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.613083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.613361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.613630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.614262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:23.614561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:23.615942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:23.627545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 624/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:23.633818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.731893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1d90b-2a93-4c67-b061-51079790e821 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.758642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:23.766200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.766828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.767152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.767446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.775562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:23.777030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:23.788106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:23.789283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:23.790473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:23.794385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 629/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:23.795426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:23.848555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:23.890838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc53238-be80-4a7b-8d03-77a24d9d4b76 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:23.923014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:23.923804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:23.926119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:23.926119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:23.926119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:23.926119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:23.927445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:23.945952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 625/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:23.951759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.053136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3b1a-36a9-43e5-ad90-7e2f42effd24 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:24.086493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:24.087098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:24.087380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:24.087655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:24.140816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:24.152449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:24.153882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:24.250156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 630/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:45:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:45:24.256155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.352966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc407d-1509-45e8-8dab-e99fb2f46e05 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:24.365698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:24.386928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:24.387555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:24.388160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:24.388433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:24.398088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:24.399481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:24.417688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:24.419850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:24.420962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:24.420962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:24.420962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:24.420962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 626/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:24.425661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.513653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:24.526144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86dc73-d973-4061-bc78-c3199badba27 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:24.559434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:24.560073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:24.560357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:24.560698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:24.561337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:24.561640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:24.563006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:24.573980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 631/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:24.579707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.678803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92568f50-2aca-4f22-bc0c-c029d6ef7e2f None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:24.710876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:24.711498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:24.711779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:24.712082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:24.718762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:24.720272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:24.731953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:24.733022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:24.734126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:24.734648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 627/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:24.739884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.839310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db3280-31d2-42ef-b7c9-c00248966194 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:24.870997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:24.871606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:24.871883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:24.872179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:24.872988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:24.873291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:24.874699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d375dd9b-983e-4512-b57f-1aa9b5825064 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:24.886813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 632/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:24.893027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:24.919186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:24.992888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbddd7-84dc-4456-9d9d-f5ce072d4563 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:25.025920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:25.026513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:25.026789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:25.027055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:25.027897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=4590313e50ef4de6b2d6a54467b13a12) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:25.028232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:25.029632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd6bbc-cc47-4957-bcd6-33275c807f5d None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:25.035008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 628/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:45:24 2022] GET /identity/v3/role_assignments?user.id=4590313e50ef4de6b2d6a54467b13a12&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:27.139380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2a8c-3210-4b88-813b-45f2239b0c74 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:27.139995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2a8c-3210-4b88-813b-45f2239b0c74 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:27.140109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2a8c-3210-4b88-813b-45f2239b0c74 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:27.141382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 633/1261] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:27.146535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:27.146924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:27.147085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:27.165583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:27.167059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:27.232074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 629/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:27.505551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb2a8c-3210-4b88-813b-45f2239b0c74 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:27.516175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:27.605413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb2a8c-3210-4b88-813b-45f2239b0c74 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:27.640041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:27.640668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:27.640956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:27.641258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:27.651743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:27.656611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:27.657696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:27.658735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 634/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:27.664440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:27.682404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:27.761721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5530d-121d-4a92-b773-3a4c910efa06 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:27.795464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:27.796138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:27.796418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:27.796693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:27.797354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:27.797660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:27.799023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:27.806841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 630/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:27.812649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:27.877374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:27.911652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83daa2b0-66a6-47f6-92e8-741d70cb8b94 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:27.944143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:27.945265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:27.945542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:27.945812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:27.956032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:27.957503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:27.971789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:27.972770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:27.973819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:27.973819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:27.973819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:27.973819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 635/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:27.978636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.059653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:28.078158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6b647-e145-417a-a40d-f3291fd80080 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.110288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.110922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.111207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.111484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.112152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:28.112462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.113880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.125998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 631/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:28.131855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.231877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4685d-9cb6-4ff4-a77d-14870fb53228 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.251699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:28.266144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.266776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.267055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.267325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.274561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.276035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:28.287038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:28.288172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:28.294344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 636/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:28.294930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.396080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73f92e-188a-4f58-b48d-a217493d9cc0 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.431407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.432046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.432330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.432604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.433334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:28.433644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.435090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.443618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:28.452374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 632/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:28.458303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.568728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddce94b-d031-4e29-bfa9-53b1fb9abc80 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.601743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.602376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.602661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.602949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.613390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.614841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:28.629173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:28.630293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:28.631379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:28.631379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:28.631379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:28.631379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 637/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:28.637578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.736457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344e3c1-186a-429c-a5a8-8b838da7f5e5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.770709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.771310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.771592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.771866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.772622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:28.772923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.774305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.785250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 633/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:28.791709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:28.823018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:28.890156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8670-87f0-4cc4-9085-9ab2b5f9f297 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:28.924226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:28.924844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:28.925124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:28.925396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:28.932503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:28.933981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:28.945041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:28.946169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:28.947550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 638/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:28.952033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:29.010168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:29.050132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb52be-3071-4c26-8cc4-76ec1adb3de5 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:29.082663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:29.083265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:29.083544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:29.083812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:29.084523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:29.084827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:29.086748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac3198-9703-41f8-a3d8-9b062e9656d8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:29.098386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 634/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:29.105212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:29.195256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:29.204082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350d259-1315-457b-9acf-632dea92bc33 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:29.237499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:29.238153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:29.238431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:29.238705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] PATH_INFO: `/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/4590313e50ef4de6b2d6a54467b13a12/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:29.240577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0309a7534d124324bb6a3a964e804ba5, user_id=4590313e50ef4de6b2d6a54467b13a12, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:29.242026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958200f-6530-4402-b49f-f11af34108b2 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:29.467410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 639/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Sep 23 13:45:29 2022] PUT /identity/v3/projects/0309a7534d124324bb6a3a964e804ba5/users/4590313e50ef4de6b2d6a54467b13a12/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:45:31.575574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ffce-ce0f-4b8d-a069-4dd8e580add8 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:31.576164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ffce-ce0f-4b8d-a069-4dd8e580add8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:31.576164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3ffce-ce0f-4b8d-a069-4dd8e580add8 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:31.577493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 635/1274] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:31.582789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:31.583201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:31.583421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:31.602265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:31.603440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:31.668887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 640/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:31.934199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ffce-ce0f-4b8d-a069-4dd8e580add8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.032737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3ffce-ce0f-4b8d-a069-4dd8e580add8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.049437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:32.065908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.066527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.066802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.067070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.077219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 23 13:45:32.081973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:32.083106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:32.084251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 636/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Sep 23 13:45:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 23 13:45:32.090774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.172057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:32.189585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976046e-f960-4c0a-9e9e-c1edda36648c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.222065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.222676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.222958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.223239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.224040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:32.224351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:32.225756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:32.233558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 641/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:32.239429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.338656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43bfd8-68fd-46f3-869e-0ae1a8f6f4e6 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.372788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.373468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.373746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.374064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.384193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:32.385633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:32.399686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:32.400846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:32.402156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:32.402156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:32.402156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:32.402156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 637/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:32.406633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.506624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a442-0b07-4275-b6e4-c48fe55504f3 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.539261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.539867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.540180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.540453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.541356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:32.541658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:32.543048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:32.555094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 642/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:32.560824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.590795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:32.656620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b469-a292-4b4c-bac0-5a95494c72b3 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.690621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.691237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.691518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.691794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.699786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:32.701251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 23 13:45:32.712648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:32.713792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:32.714940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 638/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:32.719661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.723423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:32.816060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ee20d-dbb4-405c-b377-1b0f42ad5a5e None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:32.850388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:32.851566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:32.851847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:32.852147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:32.852859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:32.853160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:32.854633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:32.871074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 643/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 13:45:32.876876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:32.964980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:32.974123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5639eb-40e1-4694-9f01-66dde3446942 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.006737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.007380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.007700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.008080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.074732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.076210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.162234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:33.172540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 639/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Sep 23 13:45:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 23 13:45:33.178378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:33.239203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:33.276922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32d80b-2a49-40c5-861d-60cd84ef42bc None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.310151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.310769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.311121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.311392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.321927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.327999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 23 13:45:33.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:33.337625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 23 13:45:33.338678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 23 13:45:33.338678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 23 13:45:33.338678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:33.338678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 644/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:33.343564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:33.441417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f0645-f864-4066-ab97-68b4d75c19b7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.480292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.480900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.481177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.481445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.482161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:33.482461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.483817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.494912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 640/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Sep 23 13:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:33.500693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:33.597380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eefab-2464-4d07-b520-392087ec464d None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.611362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:33.630799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.631425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.631702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.632000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.638439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.639879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 23 13:45:33.651686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:33.652693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: ERROR keystone.server.flask.application Sep 23 13:45:33.653579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 645/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Sep 23 13:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:33.658671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:33.708625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:33.757194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e888-78cf-4cb0-8f09-1328e4af84b7 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.789824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.790469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.791026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.791307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.792059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:33.792370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.793800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed303fac-b239-4fa1-af54-6066c34732d8 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.806257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 641/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Sep 23 13:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:33.812580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:33.910968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dac7a-5d7f-4a5d-acb8-4875d002c2f9 None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:33.943773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:33.944402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:33.944684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:33.944960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:33.945677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] RBAC: Adding query filter params (role.id=0dadbccfa43b4e9fb658d0386627fc21, scope.project.id=0309a7534d124324bb6a3a964e804ba5, user.id=4590313e50ef4de6b2d6a54467b13a12) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:33.946489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:33.947936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4c45a7-771b-44b1-a529-e7631967b138 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:33.953725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 646/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Sep 23 13:45:33 2022] GET /identity/v3/role_assignments?user.id=4590313e50ef4de6b2d6a54467b13a12&scope.project.id=0309a7534d124324bb6a3a964e804ba5&role.id=0dadbccfa43b4e9fb658d0386627fc21 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:36.138809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e87ce-f236-44c8-ba16-9b90056a7620 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:36.139342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e87ce-f236-44c8-ba16-9b90056a7620 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:36.139342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e87ce-f236-44c8-ba16-9b90056a7620 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:36.140727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 642/1288] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:36.145974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:36.146357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:36.149359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:36.165346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:36.166800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:36.196217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:36.232188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 647/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:36.502044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e87ce-f236-44c8-ba16-9b90056a7620 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:36.600150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e87ce-f236-44c8-ba16-9b90056a7620 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:36.611155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:36.637327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:36.637957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:36.638239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:36.638512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:36.639091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:36.640502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:36.649142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:36.650432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:36.651621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 643/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:45:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:36.656205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:36.753830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8f396-8a0f-4eda-b499-882347f54e48 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:36.786572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:36.787169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:36.787444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:36.787713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:36.788363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:36.788659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:36.790014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ad1f6-76bd-4d15-b6be-b5f131f8c776 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:36.795590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 648/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 13:45:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:36.801403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:36.898590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffdea-5c36-40d7-98fa-2e5badf13f70 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:36.930846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:36.932076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:36.932356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:36.932627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] PATH_INFO: `/v3/services` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:36.933297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:36.933595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:36.934939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cad211-a0c8-491e-bf7f-71b453ff72c1 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:36.939252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 644/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 13:45:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:39.067941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0ed52-8942-48f5-886f-cfb12d6d938d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:39.068532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0ed52-8942-48f5-886f-cfb12d6d938d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:39.068532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e0ed52-8942-48f5-886f-cfb12d6d938d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:39.069873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 649/1293] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:39.075129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f9c-e169-4335-8b03-c76fbf634d3f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:39.075563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f9c-e169-4335-8b03-c76fbf634d3f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:39.075721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f9c-e169-4335-8b03-c76fbf634d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:39.093712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-94d97f9c-e169-4335-8b03-c76fbf634d3f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:39.099560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-94d97f9c-e169-4335-8b03-c76fbf634d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:39.124512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:39.159965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 645/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:39.432305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0ed52-8942-48f5-886f-cfb12d6d938d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:39.465187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:39.534127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e0ed52-8942-48f5-886f-cfb12d6d938d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:39.566965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:39.567570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:39.567862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:39.568162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:39.568807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:39.570183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b381303-6787-4c32-a97a-4f8df308996c None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:39.672750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 650/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Sep 23 13:45:39 2022] POST /identity/v3/services => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:45:41.804399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7b154-6478-4883-ba9b-243349731347 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:41.805000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7b154-6478-4883-ba9b-243349731347 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:41.805000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7b154-6478-4883-ba9b-243349731347 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:41.806289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 646/1296] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:41.811449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:41.813825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:41.813825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:41.830104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:41.831307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:41.902206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 651/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:41 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:42.167978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7b154-6478-4883-ba9b-243349731347 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:42.266965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7b154-6478-4883-ba9b-243349731347 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:42.299924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:42.300564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:42.300869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:42.301143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:42.301819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:42.303168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:42.311777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:42.314221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:42.315137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 647/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:45:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:42.318877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:42.337283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:42.416972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79a6bb-63f4-493b-afd4-cbf1bfb99b17 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:42.455268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:42.455805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:42.456111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:42.456382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:42.457030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:42.457337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:42.458736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:42.464014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 652/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 13:45:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:42.469848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:42.500577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:42.566765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eef2ab-c75e-466e-be2a-220a71fa2414 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:42.599847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:42.600499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:42.600779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:42.601049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:42.601742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] RBAC: Adding query filter params (interface=public, service_id=71e7e1af079b420aadc70fbcd6894b66, region_id=RegionOne) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:42.602072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:42.603463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c07e3-6302-4c02-ac1d-675e1f240236 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:42.608352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 648/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Sep 23 13:45:42 2022] GET /identity/v3/endpoints?service_id=71e7e1af079b420aadc70fbcd6894b66&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:42.614034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:42.694802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:42.712912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cecb66-0742-491f-b640-c87ad8ccbebd None admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:42.748797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:42.749403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:42.749678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:42.749946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:42.750545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:42.751936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323ff6-b56a-41e1-8c47-6112a5f43cb3 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:42.758755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 653/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Sep 23 13:45:42 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:45:44.894402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a192e-136e-48cb-938f-b1b096871c3e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:44.894989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a192e-136e-48cb-938f-b1b096871c3e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:44.894989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a192e-136e-48cb-938f-b1b096871c3e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:44.896343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 649/1302] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:45:44.901650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:44.902087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:44.902237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:44.920390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:45:44.921575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:45:44.987729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 654/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:45:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 23 13:45:45.253888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a192e-136e-48cb-938f-b1b096871c3e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:45.346889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:45.353749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a192e-136e-48cb-938f-b1b096871c3e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:45.386419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:45.387036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:45.387310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:45.387576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:45.388171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:45.389514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 23 13:45:45.398104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 23 13:45:45.399277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.get_or_create( Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application with Lock( Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self._enter() Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application return self.creator() Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application created_value = creator( Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: ERROR keystone.server.flask.application Sep 23 13:45:45.400824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 650/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Sep 23 13:45:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 23 13:45:45.405960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:45.482959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:45.505269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37eaeb-e0db-4099-b165-bda62ed245dc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:45.538626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:45.539269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:45.539548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:45.539821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] PATH_INFO: `/v3/services` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:45.541380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:45:45.541668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:45.543061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6957d419-3d4b-4568-a03d-a135f60a01f1 None admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:45.548092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 655/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Sep 23 13:45:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:45:45.554003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:45:45.653170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e861750-401f-4c76-af0f-98992896f305 None admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:45:45.686297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:45:45.688964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:45:45.688964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:45:45.688964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:45:45.688964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:45:45.689490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c10b3-9ebd-40ac-a19d-43efeb982a61 None admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:45:45.792344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 651/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:45:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:45:55.545096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=30 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:45:55.787491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:45.207793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e56df-0f18-4826-89e3-fbfd49853a0c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:45.208299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e56df-0f18-4826-89e3-fbfd49853a0c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:45.208392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e56df-0f18-4826-89e3-fbfd49853a0c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:45.210331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 656/1307] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:45.218506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de439-60d4-43a2-b1be-34cafc7d67aa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:45.219618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de439-60d4-43a2-b1be-34cafc7d67aa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:45.227186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3de439-60d4-43a2-b1be-34cafc7d67aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:45.361844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bb3de439-60d4-43a2-b1be-34cafc7d67aa None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:45.363466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bb3de439-60d4-43a2-b1be-34cafc7d67aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:45.487092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 652/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:45.776977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:45.777342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:45.777695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:45.779259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 657/1309] 10.222.0.48 () {54 vars in 964 bytes} [Fri Sep 23 13:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:45.785271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2115-f7ab-408c-98de-e3962ba953dc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:45.785697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2115-f7ab-408c-98de-e3962ba953dc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:45.786063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb2115-f7ab-408c-98de-e3962ba953dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:45.882598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-54cb2115-f7ab-408c-98de-e3962ba953dc None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:45.883849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-54cb2115-f7ab-408c-98de-e3962ba953dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:45.907600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:45.972662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 653/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Sep 23 13:51:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:45.982463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:51:45.984236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:46.097644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813b12c-bcf6-46c4-9638-96711a392cce None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:51:46.174670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:51:46.175278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:46.175557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:46.175821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:46.177485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:46.232635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:46.287717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:51:46.289188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e538-dc23-41ad-8b71-084660f6ee99 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:51:46.308256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 658/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:51:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:51:48.739615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:48.740786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:48.740786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:48.742366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 654/1312] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:48.747273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135118-52b3-496e-8781-96a2307f4d92 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:48.747668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135118-52b3-496e-8781-96a2307f4d92 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:48.747830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98135118-52b3-496e-8781-96a2307f4d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:48.817331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-98135118-52b3-496e-8781-96a2307f4d92 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:48.818498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98135118-52b3-496e-8781-96a2307f4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:48.912461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 659/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:49.198030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:51:49.199586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:49.302461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82386181-7fce-466a-b1a5-b567127e7211 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:51:49.374574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:49.376712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:51:49.377324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:49.377608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:49.377883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:49.379497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:49.489605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:51:49.491074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc57cf-371e-46a6-bfe2-69110dfeeb0f service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:51:49.509677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 655/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:51:52.156954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fbdf-7107-434b-8573-571866023e87 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:52.157488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fbdf-7107-434b-8573-571866023e87 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:52.157810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615fbdf-7107-434b-8573-571866023e87 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:52.159156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 660/1315] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:52.165026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339ab4-4307-4598-8f5f-c0fc783a7af5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:52.165451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339ab4-4307-4598-8f5f-c0fc783a7af5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:52.165567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339ab4-4307-4598-8f5f-c0fc783a7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:52.230696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca339ab4-4307-4598-8f5f-c0fc783a7af5 None None] MFA Rules not processed for user `2618505b7e7946dcb41e3023407b7251`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:52.232052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca339ab4-4307-4598-8f5f-c0fc783a7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:52.282201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:52.326716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 656/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:51:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:52.627358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:52.627643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:52.627934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:52.629288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 661/1317] 10.222.0.48 () {54 vars in 964 bytes} [Fri Sep 23 13:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:52.635487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0252-cf65-487c-a798-3a8300f0ad5c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:52.635781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0252-cf65-487c-a798-3a8300f0ad5c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:52.636097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a0252-cf65-487c-a798-3a8300f0ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:52.710400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9e3a0252-cf65-487c-a798-3a8300f0ad5c None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:52.711590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9e3a0252-cf65-487c-a798-3a8300f0ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:52.783327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 657/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Sep 23 13:51:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:52.792560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:51:52.794083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:52.804122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:52.897236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d780a-dd00-4e3e-af29-dbe02b5cb09d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:51:52.969329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:51:52.969937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:52.970219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:52.970495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:52.972150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:53.032417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:53.078576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:51:53.080045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a1d1f-2919-492f-b6e2-e8d0fcba0f94 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:51:53.097325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 662/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:51:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 13:51:56.338425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:56.338995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:56.338995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:56.340424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 658/1320] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:51:56.345690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7824986-a251-4004-b19a-0931a6a1e6e1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:56.346091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7824986-a251-4004-b19a-0931a6a1e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:56.346255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7824986-a251-4004-b19a-0931a6a1e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:56.411120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e7824986-a251-4004-b19a-0931a6a1e6e1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:51:56.412853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e7824986-a251-4004-b19a-0931a6a1e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:56.510081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 663/1321] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:51:56.796795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:51:56.798353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:56.847319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:56.899303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725bd1-a1f1-47e7-801a-1b06c08eaa34 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:51:56.971513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:51:56.972138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:51:56.972417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:51:56.972684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:51:56.974298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:51:57.082575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:51:57.089974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:51:57.091431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f65060-d06a-4ba5-a04a-6fb8024a8e59 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:51:57.109155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 659/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:00.315171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:00.315739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:00.315739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:00.317088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 664/1323] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:00.322508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2da1f-852b-4469-8944-969fec50364c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:00.322973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2da1f-852b-4469-8944-969fec50364c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:00.323080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2da1f-852b-4469-8944-969fec50364c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:00.387984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d1d2da1f-852b-4469-8944-969fec50364c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:00.389201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d1d2da1f-852b-4469-8944-969fec50364c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:00.496486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 660/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:00.777984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:00.779604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:00.798310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:00.883257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a7af-c5ed-4083-b6fa-94d0778f6ea3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:00.956324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:00.956933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:00.957210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:00.957479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:00.959716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:01.029991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:01.067515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:01.069805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293e032-8595-4900-b31d-bbcde2f6a579 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:01.088120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 665/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:03.290848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:03.291473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:03.291473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:03.292810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 661/1326] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:03.298777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf36653-cb16-451f-b5ae-1b1ff234e718 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:03.299282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf36653-cb16-451f-b5ae-1b1ff234e718 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:03.299388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf36653-cb16-451f-b5ae-1b1ff234e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:03.365881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6bf36653-cb16-451f-b5ae-1b1ff234e718 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:03.367073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6bf36653-cb16-451f-b5ae-1b1ff234e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:03.462391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 666/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:03.742274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:03.743902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:03.803824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:03.846854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6f8b8-5a29-4cff-af4a-09cd48827bab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:03.922600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:03.923206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:03.923480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:03.923753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:03.925443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:04.041406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:04.043652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:04.045231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88912b2-ed61-405d-a0df-ccf1ab8bfb6d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:04.063849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 662/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:06.271745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:06.272304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:06.272411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:06.273695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 667/1329] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:06.279124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01528-c6d4-4c7d-99a6-048c647567d3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:06.279508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01528-c6d4-4c7d-99a6-048c647567d3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:06.279752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01528-c6d4-4c7d-99a6-048c647567d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:06.347015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4ac01528-c6d4-4c7d-99a6-048c647567d3 None None] MFA Rules not processed for user `2618505b7e7946dcb41e3023407b7251`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:06.348182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4ac01528-c6d4-4c7d-99a6-048c647567d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:06.444830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 663/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:06.732721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:06.734535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:06.772657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:06.857216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f30f50-7b35-4d36-8d9c-adb704672bb4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:06.936300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:06.936911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:06.937192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:06.937463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:06.939067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:07.019662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:07.054235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:07.055676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47b21e-05ca-4019-a1ee-973759dea696 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:07.073743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 668/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:09.681412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba888-9101-4506-845a-61c842676345 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:09.681971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba888-9101-4506-845a-61c842676345 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:09.681971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ba888-9101-4506-845a-61c842676345 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:09.683594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 664/1332] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:09.688952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784157d7-079b-4e59-aff0-52cd9fcdd026 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:09.689354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784157d7-079b-4e59-aff0-52cd9fcdd026 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:09.689508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784157d7-079b-4e59-aff0-52cd9fcdd026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:09.753820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-784157d7-079b-4e59-aff0-52cd9fcdd026 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:09.755016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-784157d7-079b-4e59-aff0-52cd9fcdd026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:09.848462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 669/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:10.126667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba888-9101-4506-845a-61c842676345 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:10.128251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a46ba888-9101-4506-845a-61c842676345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:10.197196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:10.230595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ba888-9101-4506-845a-61c842676345 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:10.301837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:10.302968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:10.303243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:10.303509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:10.305131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:10.410921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:10.412808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c17b3-f7df-4100-92ec-25004399b9f8 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:10.422734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:10.431339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 665/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:12.625768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:12.626267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:12.626371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:12.627671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 670/1335] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:12.633373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787ce9-52f4-4e6f-951e-929fd40d0a1f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:12.633787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787ce9-52f4-4e6f-951e-929fd40d0a1f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:12.633926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35787ce9-52f4-4e6f-951e-929fd40d0a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:12.699772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-35787ce9-52f4-4e6f-951e-929fd40d0a1f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:12.701035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-35787ce9-52f4-4e6f-951e-929fd40d0a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:12.794597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 666/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:13.079008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:13.080616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:13.120867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:13.185065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb0fa3-3413-4967-83f6-3c9ce954aff2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:13.257431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:13.258032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:13.258308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:13.258577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:13.260201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:13.340754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:13.366629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:13.368097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de1ad-65ee-4eba-b13a-ae823f5e9aa4 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:13.385327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 671/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:16.041539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:16.042113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:16.042113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:16.043415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 667/1338] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:16.048541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb461-9e9b-4bba-a229-5d5aeea2e39a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:16.048955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb461-9e9b-4bba-a229-5d5aeea2e39a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:16.049097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ceb461-9e9b-4bba-a229-5d5aeea2e39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:16.113187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-30ceb461-9e9b-4bba-a229-5d5aeea2e39a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:16.114416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-30ceb461-9e9b-4bba-a229-5d5aeea2e39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:16.208197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 672/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:16.485250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:16.486784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:16.561238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:16.588401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226da30-8131-4cbf-a46a-0a7ec0dd1c7c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:16.660585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:16.661189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:16.661467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:16.662247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:16.663820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:16.768714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:16.770136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7a106-0e3b-43b0-8399-ee68ef7a3c52 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:16.788579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 668/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:21.166210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:21.166787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:21.166787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:21.168248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 673/1341] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:21.173694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745243-ce78-4cbe-86be-9f2b237d6b98 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:21.174141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745243-ce78-4cbe-86be-9f2b237d6b98 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:21.174251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8745243-ce78-4cbe-86be-9f2b237d6b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:21.179869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:21.245844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e8745243-ce78-4cbe-86be-9f2b237d6b98 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:21.247166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e8745243-ce78-4cbe-86be-9f2b237d6b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:21.350956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 669/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:21.634995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:21.636573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:21.685661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:21.740813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d663cd-8bb0-456f-b827-9237df44b5f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:21.815213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:21.815823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:21.816348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:21.816624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:21.818714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:21.912999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:21.928798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:21.930330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d66cb9-6d66-4f03-a231-64d4d668244c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:21.949389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 674/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:25.049227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:25.049750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:25.049870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:25.051123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 670/1344] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:25.056952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b24eb-9551-4fc7-8122-5a6e26d260a3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:25.057384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b24eb-9551-4fc7-8122-5a6e26d260a3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:25.057634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b24eb-9551-4fc7-8122-5a6e26d260a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:25.128676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e0b24eb-9551-4fc7-8122-5a6e26d260a3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:25.129894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e0b24eb-9551-4fc7-8122-5a6e26d260a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:25.225722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 675/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:25.509198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:25.510758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:25.595940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:25.613774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6a7da-1e1c-4cd6-9b14-0abf1c87ddbc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:25.689102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:25.689724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:25.690009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:25.690286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:25.691904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:25.818796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:25.820572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80c397-40cd-45d0-8254-93823e556e85 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:25.840878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 671/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:30.204142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:30.204709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:30.204709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:30.206050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 676/1347] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:30.211686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802d4b-8966-4a76-bc8a-8cba9c5c9bfb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:30.212166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802d4b-8966-4a76-bc8a-8cba9c5c9bfb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:30.212263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802d4b-8966-4a76-bc8a-8cba9c5c9bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:30.229585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:30.283469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-05802d4b-8966-4a76-bc8a-8cba9c5c9bfb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:30.284800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-05802d4b-8966-4a76-bc8a-8cba9c5c9bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:30.382278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 672/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:30.667886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:30.669528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:30.728246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:30.774495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c11e1-a5f8-44ef-8cd5-b7c69b6a2ff1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:30.848840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:30.849405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:30.849684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:30.849957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:30.851648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:30.960764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:30.964367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:30.965809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d2d581-c6ba-448b-b423-646e634fa531 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:30.983347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 677/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:35.894733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724c0-742d-43b1-b6f9-7a9af0f45775 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:35.895142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724c0-742d-43b1-b6f9-7a9af0f45775 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:35.895282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7724c0-742d-43b1-b6f9-7a9af0f45775 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:35.898419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 673/1350] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 13:52:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:35.903298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7ee8-c0ef-477b-bdee-90436053805c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:35.903713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7ee8-c0ef-477b-bdee-90436053805c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:35.903899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b7ee8-c0ef-477b-bdee-90436053805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:36.020842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3d1b7ee8-c0ef-477b-bdee-90436053805c None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:36.021974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3d1b7ee8-c0ef-477b-bdee-90436053805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:36.187966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 678/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 13:52:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:40.380756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=59 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:40.415135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b463-ad95-428f-b7d5-55be97b5ee50 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:40.415491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b463-ad95-428f-b7d5-55be97b5ee50 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:40.415705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0125b463-ad95-428f-b7d5-55be97b5ee50 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:40.417263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 674/1352] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 13:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:40.422366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426cd6-a4c5-42c5-a86d-0aaf5d2f338f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:40.423242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426cd6-a4c5-42c5-a86d-0aaf5d2f338f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:40.423728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d426cd6-a4c5-42c5-a86d-0aaf5d2f338f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:40.495555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:40.519487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d426cd6-a4c5-42c5-a86d-0aaf5d2f338f None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:40.522208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d426cd6-a4c5-42c5-a86d-0aaf5d2f338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:40.649755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 679/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:41.887758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424680dd-4570-4a0b-a614-93b97c51d729 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:41.888313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424680dd-4570-4a0b-a614-93b97c51d729 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:41.888408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424680dd-4570-4a0b-a614-93b97c51d729 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:41.889738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 675/1354] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 13:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:41.895056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122260-7143-4de2-b11a-da976834b8ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:41.895456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122260-7143-4de2-b11a-da976834b8ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:41.895623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d122260-7143-4de2-b11a-da976834b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:41.976566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0d122260-7143-4de2-b11a-da976834b8ec None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:41.977825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d122260-7143-4de2-b11a-da976834b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:42.019469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:42.085263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 680/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:52:45.597223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aaf0-d3df-4863-b1f9-09f082c2305a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:45.598213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aaf0-d3df-4863-b1f9-09f082c2305a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:45.598701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aaf0-d3df-4863-b1f9-09f082c2305a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:45.601128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 676/1356] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:45.606882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f876f-84e5-4383-ae1f-db9da5de866a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:45.607835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f876f-84e5-4383-ae1f-db9da5de866a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:45.608397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f876f-84e5-4383-ae1f-db9da5de866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:45.680469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-181f876f-84e5-4383-ae1f-db9da5de866a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:45.681664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-181f876f-84e5-4383-ae1f-db9da5de866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:45.786852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 681/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:46.088029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:46.088416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:46.088586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:46.090092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 677/1358] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 13:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:46.103453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6628-308e-4c1c-8337-d1f4abb34269 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:46.103894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6628-308e-4c1c-8337-d1f4abb34269 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:46.104283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b6628-308e-4c1c-8337-d1f4abb34269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:46.124085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:46.187839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fc3b6628-308e-4c1c-8337-d1f4abb34269 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:46.189709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc3b6628-308e-4c1c-8337-d1f4abb34269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:46.313880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 682/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:52:46.322246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:46.324577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:46.493330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5d0d7-1623-4362-922e-7eae5743ae87 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:46.570897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:46.611335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:46.612046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:46.612316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:46.612589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:46.614234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:46.710232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:46.711962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906e7e1-251d-4313-b160-191587017e88 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:46.733602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 678/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 13:52:49.098293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:49.099366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:49.099366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:49.100733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 683/1361] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:49.106256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa0f7-6e6b-4416-996c-b94cbe0d0b78 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:49.106702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa0f7-6e6b-4416-996c-b94cbe0d0b78 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:49.107012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fa0f7-6e6b-4416-996c-b94cbe0d0b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:49.194260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a39fa0f7-6e6b-4416-996c-b94cbe0d0b78 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:49.197144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a39fa0f7-6e6b-4416-996c-b94cbe0d0b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:49.249099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:49.319258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 679/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:49.610937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:49.612528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:49.679975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:49.770621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7381b04a-e7da-4962-b71f-7528fc2ae52f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:49.914451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:49.915069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:49.915347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:49.915618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:49.917241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:49.949368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:50.015223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:50.016911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd16fa-81e9-4c3d-b6d7-992621730580 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:50.036520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 684/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:52.653365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67625-92d8-496f-ac74-8a9d18245423 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:52.653908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67625-92d8-496f-ac74-8a9d18245423 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:52.653908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab67625-92d8-496f-ac74-8a9d18245423 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:52.655280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 680/1364] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:52.660677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e55bc7-a52c-4cb5-bd5c-b2789c8127d3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:52.661096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e55bc7-a52c-4cb5-bd5c-b2789c8127d3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:52.661416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e55bc7-a52c-4cb5-bd5c-b2789c8127d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:52.730692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a8e55bc7-a52c-4cb5-bd5c-b2789c8127d3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:52.732103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a8e55bc7-a52c-4cb5-bd5c-b2789c8127d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:52.833468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:52.841787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 685/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:53.134631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:53.134926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:53.135208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:53.137001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 681/1366] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 13:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:53.142204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace11da-3d6e-4f7f-aaa5-16b6ea9e1891 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:53.142612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace11da-3d6e-4f7f-aaa5-16b6ea9e1891 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:53.142988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace11da-3d6e-4f7f-aaa5-16b6ea9e1891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:53.221491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2ace11da-3d6e-4f7f-aaa5-16b6ea9e1891 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:53.222835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2ace11da-3d6e-4f7f-aaa5-16b6ea9e1891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:53.347402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 686/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:53.357217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:53.358990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:53.515218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614aac7b-d34a-4358-8868-dfe8c767aeb6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:53.536818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:53.638372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:53.639073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:53.639423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:53.639767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:53.641483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:53.738249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:53.740741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6a8d6-77c9-4149-9c75-011da787957f service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:53.761972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 682/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:53.842888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ae29-30cc-4b0d-bc1b-bbb45893272a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:53.843449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ae29-30cc-4b0d-bc1b-bbb45893272a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:53.843449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221ae29-30cc-4b0d-bc1b-bbb45893272a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:53.844812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 687/1369] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:53.851770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7324-7450-43c1-9a89-17dd2149ef49 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:53.852187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7324-7450-43c1-9a89-17dd2149ef49 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:53.852469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f7324-7450-43c1-9a89-17dd2149ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:53.887477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:53.924531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0f1f7324-7450-43c1-9a89-17dd2149ef49 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:53.925788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0f1f7324-7450-43c1-9a89-17dd2149ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:54.032803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 683/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:54.370786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:54.370786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:54.370786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:54.372636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 688/1371] 10.222.0.48 () {54 vars in 963 bytes} [Fri Sep 23 13:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:54.377053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781817c-54e2-4080-836c-db6ef7382270 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:54.377344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781817c-54e2-4080-836c-db6ef7382270 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:54.377620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781817c-54e2-4080-836c-db6ef7382270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:54.459129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b781817c-54e2-4080-836c-db6ef7382270 None None] MFA Rules not processed for user `983535804007417db2c2f7727e70cda7`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:54.462944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b781817c-54e2-4080-836c-db6ef7382270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:54.514032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:54.544497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 684/1372] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Sep 23 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:54.552299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:54.553810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:54.608924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:54.667060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52222340-0a33-4e24-a919-18b01fe474f5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:54.749501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:54.750367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:54.750782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:54.751060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:54.752737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:54.857781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:54.874902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:54.876830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e0725-6655-46c3-89b7-17b69c16acf1 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:54.899337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 689/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:56.282397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:56.282845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:56.282938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:56.284473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 685/1374] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:56.290457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879930-8e07-4f48-bc1e-e79df9fdd392 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:56.290913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879930-8e07-4f48-bc1e-e79df9fdd392 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:56.291022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76879930-8e07-4f48-bc1e-e79df9fdd392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:56.358612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-76879930-8e07-4f48-bc1e-e79df9fdd392 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:56.359963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-76879930-8e07-4f48-bc1e-e79df9fdd392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:56.457669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 690/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:56.749645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:56.751204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:56.904480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0351c-aaad-414c-8715-ad7eba310451 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:52:56.961228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:57.027887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:52:57.028533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:57.028811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:57.029081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:57.030697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:57.126058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:52:57.127712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49998a16-363c-405d-9b0e-5092fd403753 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:52:57.148190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 686/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:52:59.527068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:59.527648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:59.527648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:59.529140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 691/1377] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:52:59.534157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b813d9-d360-4fae-8d64-2fda85f5680e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:52:59.534572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b813d9-d360-4fae-8d64-2fda85f5680e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:52:59.534720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b813d9-d360-4fae-8d64-2fda85f5680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:52:59.601858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b2b813d9-d360-4fae-8d64-2fda85f5680e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:52:59.603209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b2b813d9-d360-4fae-8d64-2fda85f5680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:52:59.610546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:52:59.704038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 687/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:52:59.993653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:52:59.995176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:00.063028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:00.154572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f734ed3-44f3-4596-8a6d-dd702ccdb0e6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:00.275993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:00.276608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:00.276883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:00.277152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:00.278718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:00.298336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:00.372626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:00.374263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e6f5f7-ed03-4fe8-9367-f7bab532e1c8 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:00.393623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 692/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:02.706547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:02.707097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:02.707097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:02.708854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 688/1380] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:02.713748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fef1-12c3-4667-bac5-325516b0f74f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:02.714171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fef1-12c3-4667-bac5-325516b0f74f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:02.714289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431fef1-12c3-4667-bac5-325516b0f74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:02.781911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5431fef1-12c3-4667-bac5-325516b0f74f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:02.782922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5431fef1-12c3-4667-bac5-325516b0f74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:02.884952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:02.890552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 693/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:03.186153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:03.187745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:03.326562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:03.336698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d71eb9-f79e-4b70-9c9a-d1c7aa21b524 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:03.449427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:03.450063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:03.450353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:03.450606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:03.452234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:03.543378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:03.545022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4cf7a-ad39-44f5-8599-29b68c1be089 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:03.555688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:03.564425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 689/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:06.479246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:06.479883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:06.479883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:06.481221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 694/1383] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:06.486977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c95-158a-4ba0-a2b1-f076a874248a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:06.487462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c95-158a-4ba0-a2b1-f076a874248a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:06.487612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25704c95-158a-4ba0-a2b1-f076a874248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:06.555163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-25704c95-158a-4ba0-a2b1-f076a874248a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:06.556443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-25704c95-158a-4ba0-a2b1-f076a874248a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:06.659397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 690/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:06.948954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:06.950553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:07.105262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b262d-7662-4d98-b4f4-88b388f4a1f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:07.183200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:07.233366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:07.233979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:07.234255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:07.234524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:07.236183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:07.333534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:07.335232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2497d-982c-4d2b-9a57-1bf3a5584d45 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:07.353989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 695/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:09.589206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:09.589768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:09.589768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:09.591103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 691/1386] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:09.596429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36869-af71-479a-bb04-7df8d6d97d6f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:09.596902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36869-af71-479a-bb04-7df8d6d97d6f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:09.597011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e36869-af71-479a-bb04-7df8d6d97d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:09.663898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-11e36869-af71-479a-bb04-7df8d6d97d6f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:09.665131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11e36869-af71-479a-bb04-7df8d6d97d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:09.699476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:09.764802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 696/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:10.052526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:10.054049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:10.129444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:10.199281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69a5a6-ce73-4bfe-ae78-22faa6d53b08 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:10.312213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:10.312749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:10.313028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:10.313303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:10.314905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:10.354647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:10.407761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:10.409415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1dbf9-1e9d-4bc8-9dbd-d14a80f137b6 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:10.427855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 692/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:10.672672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e4b3-d701-4513-8099-e1fc7078645f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:10.673261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e4b3-d701-4513-8099-e1fc7078645f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:10.673261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430e4b3-d701-4513-8099-e1fc7078645f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:10.674681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 697/1389] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:10.681186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fdab4-c3e9-483b-adc8-44df0db1801a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:10.681729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fdab4-c3e9-483b-adc8-44df0db1801a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:10.681729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fdab4-c3e9-483b-adc8-44df0db1801a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:10.754657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-aa8fdab4-c3e9-483b-adc8-44df0db1801a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:10.756572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aa8fdab4-c3e9-483b-adc8-44df0db1801a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:10.855200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 693/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:11.156783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:11.157073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:11.157378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:11.158712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 698/1391] 10.222.0.48 () {54 vars in 962 bytes} [Fri Sep 23 13:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:11.164616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50303-cc33-4d28-95ba-9b52dbd96500 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:11.164927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50303-cc33-4d28-95ba-9b52dbd96500 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:11.165200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c50303-cc33-4d28-95ba-9b52dbd96500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:11.180655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:11.241218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-67c50303-cc33-4d28-95ba-9b52dbd96500 None None] MFA Rules not processed for user `b6621711a3aa475fad33e482bd096989`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:11.242470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-67c50303-cc33-4d28-95ba-9b52dbd96500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:11.317514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 694/1392] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Sep 23 13:53:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:11.326628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:11.328185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:11.432645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288c6ba-8fcc-404e-a015-8d46797f87b6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:11.492459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:11.509698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:11.510306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:11.510640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:11.510907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:11.512536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:11.621713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:11.623175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be577190-fa3e-4829-bab6-8d47a008c0c6 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:11.641933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 699/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:12.523235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd0f-a647-4ffd-a642-ace2a204f703 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:12.523702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd0f-a647-4ffd-a642-ace2a204f703 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:12.523811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413fd0f-a647-4ffd-a642-ace2a204f703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:12.591200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2413fd0f-a647-4ffd-a642-ace2a204f703 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:12.592473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2413fd0f-a647-4ffd-a642-ace2a204f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:12.650102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:12.683284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 695/1394] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:12.730441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebab23-46fa-41aa-9b1a-ec8c4e05a3b4 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:12.730909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebab23-46fa-41aa-9b1a-ec8c4e05a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:12.731019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebab23-46fa-41aa-9b1a-ec8c4e05a3b4 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:12.732396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 700/1395] 10.222.0.48 () {54 vars in 943 bytes} [Fri Sep 23 13:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:12.738886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:12.739211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:12.739488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:12.795699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935c23-9b89-4507-bf87-a97eb2e22d4c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:12.796019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935c23-9b89-4507-bf87-a97eb2e22d4c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:12.796302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8935c23-9b89-4507-bf87-a97eb2e22d4c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:12.797807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 701/1396] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 13:53:12.802547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:12.802838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:12.803112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:12.817678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] MFA Rules not processed for user `e30835b6a01b456bb97d745ad0052a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:12.818893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:12.868974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:12.870227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:12.912530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:12.926888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 696/1397] 10.222.0.48 () {58 vars in 1040 bytes} [Fri Sep 23 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:12.936886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:12.946456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70a1a6-be7e-4235-bd1b-afce21f677ec None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:12.970214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 702/1398] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:12.973170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:13.052996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:13.053608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:13.053889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:13.054162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:13.055850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:13.138845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:13.140511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471d240-7968-4c81-a3dc-03a49018df9e service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:13.149192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 697/1399] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 13:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 13:53:13.258652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:13.259862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:13.372532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fae5b8-9995-4bb3-a2be-88629a8e610b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:13.430451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:13.487454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:13.488328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:13.488608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:13.488880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:13.490993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:13.601964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:13.603660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532b2a2-33b3-4df8-adc3-416f085c0b5a service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:13.623462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 703/1400] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:15.945609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:15.946220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:15.946220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:15.947492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 698/1401] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:15.952877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc604-0eec-4a4e-8897-48edfcd2dec3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:15.953338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc604-0eec-4a4e-8897-48edfcd2dec3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:15.953338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dc604-0eec-4a4e-8897-48edfcd2dec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:16.026457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-677dc604-0eec-4a4e-8897-48edfcd2dec3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:16.027669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-677dc604-0eec-4a4e-8897-48edfcd2dec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:16.042717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:16.135295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 704/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:16.428521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:16.433871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:16.508656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:16.604454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332783-a8fb-409d-9d8f-923e9c8d5bb3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:16.734716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:16.735760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:16.736268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:16.736542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:16.738186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:16.758596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:16.842761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:16.844402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71aff4-153f-4525-9d7c-57c006a59da3 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:16.863968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 699/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:19.247411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:19.248026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:19.248026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:19.249322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 705/1404] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:19.254485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9eaed-721e-4468-94f8-a6c0ea6e2508 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:19.255421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9eaed-721e-4468-94f8-a6c0ea6e2508 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:19.255578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9eaed-721e-4468-94f8-a6c0ea6e2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:19.329931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-39d9eaed-721e-4468-94f8-a6c0ea6e2508 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:19.331159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-39d9eaed-721e-4468-94f8-a6c0ea6e2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:19.430691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:19.437480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 700/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:19.733982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:19.735614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:19.918457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:19.921284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37abcf3a-65df-428a-bb0e-69a7d9233806 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:20.085487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:20.086264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:20.086612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:20.086944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:20.088864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:20.196599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:20.198327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eab988-3321-4ac5-ae56-8345d5a30e16 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:20.220557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 706/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:22.859939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:22.860518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:22.860518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:22.862114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 701/1407] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:53:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:22.868484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ce99-b3d0-4f65-8494-d0d6e1e7bde0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:22.869283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ce99-b3d0-4f65-8494-d0d6e1e7bde0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:22.869586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1ce99-b3d0-4f65-8494-d0d6e1e7bde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:22.874601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:22.942797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1bd1ce99-b3d0-4f65-8494-d0d6e1e7bde0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:22.944403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1bd1ce99-b3d0-4f65-8494-d0d6e1e7bde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:23.048270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 707/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:23.355809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:23.357380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:23.584823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bcc75-2880-419f-8237-a5a71b00eada None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:23.668643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:23.725017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:23.725017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:23.725017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:23.725017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:23.726924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:23.828657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:23.830297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601af0e-e78e-424c-aea0-4ece557bb5ea service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:23.855674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 702/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:33.046630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=64 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:33.853416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=64 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:36.749311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc81c-1193-4f0c-a5a1-eec52ce24186 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:36.749874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc81c-1193-4f0c-a5a1-eec52ce24186 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:36.749874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcc81c-1193-4f0c-a5a1-eec52ce24186 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:36.751247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 708/1410] 10.222.0.48 () {54 vars in 918 bytes} [Fri Sep 23 13:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:36.756269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a217bd-d29f-494b-b181-b65502438b1f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:36.756679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a217bd-d29f-494b-b181-b65502438b1f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:36.756809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a217bd-d29f-494b-b181-b65502438b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:36.831237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-40a217bd-d29f-494b-b181-b65502438b1f None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:36.832494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-40a217bd-d29f-494b-b181-b65502438b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:36.938508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 703/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Sep 23 13:53:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:36.952490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29b7-71a4-4222-90ae-e774ad2ff141 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:36.952800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29b7-71a4-4222-90ae-e774ad2ff141 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:36.953075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a29b7-71a4-4222-90ae-e774ad2ff141 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:36.954422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 709/1412] 10.222.0.48 () {54 vars in 918 bytes} [Fri Sep 23 13:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:36.959396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651f0c-7eb3-43ac-81c5-4a9c6d4f9e09 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:36.959687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651f0c-7eb3-43ac-81c5-4a9c6d4f9e09 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:36.959990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28651f0c-7eb3-43ac-81c5-4a9c6d4f9e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:37.032431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:37.035369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-28651f0c-7eb3-43ac-81c5-4a9c6d4f9e09 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:37.036609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-28651f0c-7eb3-43ac-81c5-4a9c6d4f9e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:37.151285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 704/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Sep 23 13:53:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:39.720963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:39.721492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:39.721492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:39.722840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:39.728187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4f48-6b1a-4325-97ed-be44416723b3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:39.728603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4f48-6b1a-4325-97ed-be44416723b3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:39.728738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec4f48-6b1a-4325-97ed-be44416723b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:39.794695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5bec4f48-6b1a-4325-97ed-be44416723b3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:39.795947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5bec4f48-6b1a-4325-97ed-be44416723b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:39.850496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:39.892134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:40.181246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:40.182815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:40.327586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa12bb-5461-49a9-9771-02cb11c36656 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:40.399960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:40.441004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:40.441565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:40.441834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:40.442135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:40.443745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:40.532850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:40.534458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cea410-4310-49f7-bdf7-2838a56ed224 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:40.552604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 711/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:41.699142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:41.699679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:41.699805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:41.701103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:41.707500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be104e-02a9-4dc1-bcfb-d93f88924e12 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:41.707912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be104e-02a9-4dc1-bcfb-d93f88924e12 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:41.708070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be104e-02a9-4dc1-bcfb-d93f88924e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:41.781988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-38be104e-02a9-4dc1-bcfb-d93f88924e12 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:41.783190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-38be104e-02a9-4dc1-bcfb-d93f88924e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:41.810833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:41.882025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:42.037813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:42.039419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:42.185663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0487dc-f283-4056-9b0e-d4fdbe49b760 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:42.227282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:42.299179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:42.299701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:42.300004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:42.300275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:42.301905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:42.389975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:42.391595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c1a95-6868-42ec-a82b-4d5c14e6031a service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:42.409629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 707/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:43.523282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:43.523796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:43.523933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:43.525321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:43.531420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1dbc6-5d55-4714-b5b1-98e24b424969 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:43.531852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1dbc6-5d55-4714-b5b1-98e24b424969 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:43.531984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1dbc6-5d55-4714-b5b1-98e24b424969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:43.585396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:43.606672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bdf1dbc6-5d55-4714-b5b1-98e24b424969 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:43.618588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bdf1dbc6-5d55-4714-b5b1-98e24b424969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:43.700308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:43.850343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:43.852006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:43.995224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e583acbc-2d2e-4020-8333-55d724bbc782 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:44.007568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:44.106785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:44.107333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:44.107606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:44.107869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:44.109501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:44.200127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:44.201730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8c30c-6d20-49e9-905c-216fc4256631 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:44.219829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 714/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:45.318500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:45.319090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:45.319090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:45.320531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:45.327088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892905-72aa-4385-9a6b-dedc707762a6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:45.327553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892905-72aa-4385-9a6b-dedc707762a6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:45.327644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892905-72aa-4385-9a6b-dedc707762a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:45.346882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:45.401959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2e892905-72aa-4385-9a6b-dedc707762a6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:45.403169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e892905-72aa-4385-9a6b-dedc707762a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:45.501072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:45.650570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:45.652076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:45.758407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:45.794172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b4d70-05f9-4093-9d29-b082af950214 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:45.905156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:45.905699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:45.905977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:45.906249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:45.907852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:45.982356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:45.995773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:45.997401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3ce88-27a4-459c-acbd-85add14b09df service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:46.016673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 710/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:47.128294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:47.128830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:47.128959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:47.130240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:47.136756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ede84-6ba6-4eda-9240-9717d99151f9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:47.137482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ede84-6ba6-4eda-9240-9717d99151f9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:47.137744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ede84-6ba6-4eda-9240-9717d99151f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:47.213221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a37ede84-6ba6-4eda-9240-9717d99151f9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:47.214367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a37ede84-6ba6-4eda-9240-9717d99151f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:47.308906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:47.458911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:47.460485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:47.545057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:47.606554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ddffc-6157-41a0-9c46-e4118791be2a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:47.717826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:47.718389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:47.718663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:47.718932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:47.720570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:47.767240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:47.808255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:47.810124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3f8cfe-348b-405b-9f79-146278a93b45 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:47.828217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 717/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:48.951510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:48.952082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:48.952082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:48.953422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:48.960251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea73f47-98e2-4700-8428-b259df98dc6c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:48.960650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea73f47-98e2-4700-8428-b259df98dc6c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:48.960800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea73f47-98e2-4700-8428-b259df98dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:49.035566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bea73f47-98e2-4700-8428-b259df98dc6c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:49.036801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bea73f47-98e2-4700-8428-b259df98dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:49.134881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:49.286979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:49.288644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:49.342097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:49.440140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52881a67-4a90-4c97-a80d-a1ee5ee23b9f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:49.669097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:49.669617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:49.669878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:49.670146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:49.671728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:49.679673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:49.760953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:49.762538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d60cb3c-e66b-42a3-be62-69f6ce72ca8e service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:49.780161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 713/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:50.918178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:50.918764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:50.918764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:50.920155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:50.926692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec7be-c3d7-43dd-994b-d79bd5c5a975 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:50.927118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec7be-c3d7-43dd-994b-d79bd5c5a975 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:50.927232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ec7be-c3d7-43dd-994b-d79bd5c5a975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:51.001501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e10ec7be-c3d7-43dd-994b-d79bd5c5a975 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:51.002700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e10ec7be-c3d7-43dd-994b-d79bd5c5a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:51.071066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:51.099390 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:51.248797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:51.250325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:51.268313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:51.392676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6589b0-a71c-4c4f-8da6-127549c60f80 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:51.478453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:51.503583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:51.504150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:51.504930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:51.505201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:51.506802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:51.594039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:51.595656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cbc3d-5175-435e-8bf5-cbad14b0a8d4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:51.613177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 720/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:52.718674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:52.719198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:52.719198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:52.720528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:52.726815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17604f-9be9-4de9-ad9e-3b78f766be81 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:52.727260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17604f-9be9-4de9-ad9e-3b78f766be81 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:52.727365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17604f-9be9-4de9-ad9e-3b78f766be81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:52.803068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0a17604f-9be9-4de9-ad9e-3b78f766be81 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:52.804297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0a17604f-9be9-4de9-ad9e-3b78f766be81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:52.844386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:52.898510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:53:53.048604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:53.050128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:53.194162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b12c17-bff7-4a81-94be-e20b7c3f3783 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:53.246981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:53.305068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:53.305594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:53.305871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:53.306141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:53.307743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:53.394770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:53.396902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee4577-ec5b-492d-8804-25c8f6cbb84e service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:53.414927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 716/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:54.514748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:54.515249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:54.515346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:54.516713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:54.523183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad29-a88f-48f9-a631-5d1dccf007fe None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:54.523756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad29-a88f-48f9-a631-5d1dccf007fe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:54.523756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877dad29-a88f-48f9-a631-5d1dccf007fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:54.597234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-877dad29-a88f-48f9-a631-5d1dccf007fe None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:54.598946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-877dad29-a88f-48f9-a631-5d1dccf007fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:54.600965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:54.693000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:54.842964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:54.844582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:54.989773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd9b61-1be4-4b8a-86c7-b0bf138d991f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:55.015944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:55.101105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:55.101635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:55.101915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:55.102190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:55.103823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:55.192470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:55.194069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74febd8-d261-4557-918a-78a4587015b8 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:55.211601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 723/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:53:57.267194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:57.267752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:57.267752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:57.269123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:53:57.275015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a4ea-c0e1-4ca2-bff4-9c704d5c0d7f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:57.275428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a4ea-c0e1-4ca2-bff4-9c704d5c0d7f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:57.275558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926a4ea-c0e1-4ca2-bff4-9c704d5c0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:57.316065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:57.342239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2926a4ea-c0e1-4ca2-bff4-9c704d5c0d7f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:53:57.343449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2926a4ea-c0e1-4ca2-bff4-9c704d5c0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:57.437662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:53:57.720831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:53:57.722401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:57.825665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a529020-bc7f-47ae-8ce4-42b9c7d34407 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:53:57.857159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:53:57.897586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:53:57.898181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:53:57.898466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:53:57.898733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:53:57.900358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:53:58.005660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:53:58.007133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f79e3-6268-45e3-8187-53539793df9c service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:53:58.025152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 719/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:00.302242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:00.302778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:00.302888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:00.304226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:00.309622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a153-425b-47e2-a4f3-c8cea99719d9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:00.310315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a153-425b-47e2-a4f3-c8cea99719d9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:00.310427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2a153-425b-47e2-a4f3-c8cea99719d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:00.374806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e8e2a153-425b-47e2-a4f3-c8cea99719d9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:00.376046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e8e2a153-425b-47e2-a4f3-c8cea99719d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:00.389049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:00.471242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:00.751516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:00.757935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:00.857856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813294dc-580e-4f89-bb26-ee2b569631f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:00.870893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:00.932271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:00.932818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:00.933097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:00.933367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:00.935328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:01.041446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:01.042875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf3b69-8d80-49d6-bbe5-546a25b1a0e3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:01.061276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 726/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:03.559636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:03.560535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:03.560535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:03.561851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:03.567168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febf84-8ba4-4ff9-b2b1-d741c19f209d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:03.567619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febf84-8ba4-4ff9-b2b1-d741c19f209d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:03.567742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92febf84-8ba4-4ff9-b2b1-d741c19f209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:03.614993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:03.632501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-92febf84-8ba4-4ff9-b2b1-d741c19f209d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:03.633711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-92febf84-8ba4-4ff9-b2b1-d741c19f209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:03.729153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:04.014799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:04.016446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:04.117793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7e5ce-f143-41c5-a559-736da3ff779e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:04.159064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:04.192295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:04.192895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:04.193169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:04.193437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:04.195026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:04.301795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:04.303151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ded034-81ae-4898-8d76-d0a88f74c0e4 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:04.322057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 722/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:06.605884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:06.606417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:06.606417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:06.607715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:06.613094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c605-0b7b-42cf-89d0-5d4aae6d060c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:06.614024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c605-0b7b-42cf-89d0-5d4aae6d060c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:06.614162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5c605-0b7b-42cf-89d0-5d4aae6d060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:06.678762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-36d5c605-0b7b-42cf-89d0-5d4aae6d060c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:06.680013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-36d5c605-0b7b-42cf-89d0-5d4aae6d060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:06.701047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:06.775116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 13:54:07.063840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:07.065453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:07.166675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bcc68f-0a3c-45ff-9ddb-c1b1390a689c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:07.187670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:07.240898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:07.241510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:07.241785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:07.242049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:07.243633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:07.354509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:07.355866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae6134e-df9c-4590-beb5-69bb680ca716 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:07.374077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 729/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:09.569178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:09.569729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:09.569729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:09.571070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:09.576530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4d29-c556-44b1-88eb-b681237c3a25 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:09.576940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4d29-c556-44b1-88eb-b681237c3a25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:09.577084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e4d29-c556-44b1-88eb-b681237c3a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:09.639961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:09.642657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c61e4d29-c556-44b1-88eb-b681237c3a25 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:09.643886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c61e4d29-c556-44b1-88eb-b681237c3a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:09.737470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:10.029333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:10.030966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:10.134701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049bbb5-3e81-4c52-8a96-7662bb4b390d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:10.185317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:10.209408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:10.210033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:10.210399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:10.210864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:10.213105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:10.320539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:10.321905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c744ba-5b97-4e52-9e41-b7f8b8b0d173 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:10.339943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 725/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:12.663942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:12.664372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:12.664483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:12.665850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:12.671242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbff93-f6fb-439b-b8b4-944a56ba0996 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:12.671639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbff93-f6fb-439b-b8b4-944a56ba0996 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:12.671788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbff93-f6fb-439b-b8b4-944a56ba0996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:12.735774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-40fbff93-f6fb-439b-b8b4-944a56ba0996 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:12.737003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-40fbff93-f6fb-439b-b8b4-944a56ba0996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:12.765569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:12.830988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:13.115534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:13.117111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:13.218502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780ca50-0537-43e8-848b-3a473eb35274 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:13.247497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:13.293185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:13.293785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:13.294060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:13.294326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:13.295910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:13.403821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:13.405222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f44a04-6348-4876-818d-8d979c397f59 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:13.423405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 732/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:15.617453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:15.618005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:15.618005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:15.619368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:15.624600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d5c9-d638-4721-b80b-5a0da800a723 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:15.625046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d5c9-d638-4721-b80b-5a0da800a723 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:15.625166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591d5c9-d638-4721-b80b-5a0da800a723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:15.689297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9591d5c9-d638-4721-b80b-5a0da800a723 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:15.690413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9591d5c9-d638-4721-b80b-5a0da800a723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:15.699018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:15.783333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:16.069610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:16.071148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:16.171762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c1045-264f-4a29-ad7c-3606b3a52965 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:16.225599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:16.244904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:16.245511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:16.245785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:16.246058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:16.247658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:16.354911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:16.356321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e263e8b-8a25-4c78-bc10-9aca36e8582e service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:16.375001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 728/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:18.561985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:18.562554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:18.562554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:18.563908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:18.569817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100ba3-580a-487a-a440-a83d2b8860f3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:18.570217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100ba3-580a-487a-a440-a83d2b8860f3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:18.570409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25100ba3-580a-487a-a440-a83d2b8860f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:18.635508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-25100ba3-580a-487a-a440-a83d2b8860f3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:18.636748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-25100ba3-580a-487a-a440-a83d2b8860f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:18.674427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:18.730998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:19.013119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:19.014665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:19.117145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb65c6-4835-4da0-86dd-849dbabce951 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:19.153521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:19.189477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:19.190080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:19.190362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:19.190636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:19.192264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:19.298229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:19.299584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b44e19-b4c9-4d2e-b0d0-b64e1b7a4577 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:19.319436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 735/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:21.476426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:21.476921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:21.477025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:21.478324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:21.483515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5de0b-668a-4d22-a079-82dfc0cb7fc3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:21.483935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5de0b-668a-4d22-a079-82dfc0cb7fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:21.484101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5de0b-668a-4d22-a079-82dfc0cb7fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:21.548639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3eb5de0b-668a-4d22-a079-82dfc0cb7fc3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:21.549856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3eb5de0b-668a-4d22-a079-82dfc0cb7fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:21.568093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:21.643627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:21.931218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:21.932859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:22.036448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf59dea-9fb5-4949-a6e3-fe7b1ba899bd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:22.101785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:22.108111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:22.108715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:22.113422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:22.113422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:22.113422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:22.217461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:22.218882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c986f-e968-49d1-8980-0ff312c7c035 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:22.236592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 731/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:24.438358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:24.438925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:24.438925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:24.440306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:24.446362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4dea5-c406-436c-977e-396735892b58 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:24.446769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4dea5-c406-436c-977e-396735892b58 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:24.446907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4dea5-c406-436c-977e-396735892b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:24.512312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dde4dea5-c406-436c-977e-396735892b58 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:24.513530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dde4dea5-c406-436c-977e-396735892b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:24.559875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:24.607232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:24.889541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:24.891194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:24.996518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00aec9-da65-41ba-bcc8-b8a2d74917a5 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:25.049135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:25.075022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:25.075650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:25.075954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:25.076237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:25.077901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:25.186137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:25.187489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb64e56-017c-4b20-8515-eb43f726a0d2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:25.205667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 738/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:34.605733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=22 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:35.203310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=66 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:45.026160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc12fb-6e80-41f0-a342-37a0b440efaa None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:45.026728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc12fb-6e80-41f0-a342-37a0b440efaa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:45.026728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc12fb-6e80-41f0-a342-37a0b440efaa None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:45.028069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 733/1471] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:45.033345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436a83-de22-4cf6-a193-5c2ed570acb9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:45.033743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436a83-de22-4cf6-a193-5c2ed570acb9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:45.033893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c436a83-de22-4cf6-a193-5c2ed570acb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:45.215233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5c436a83-de22-4cf6-a193-5c2ed570acb9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:45.216476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c436a83-de22-4cf6-a193-5c2ed570acb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:45.311113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 739/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:45.612441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:45.612729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:45.613524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:45.614883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 734/1473] 10.222.0.48 () {54 vars in 962 bytes} [Fri Sep 23 13:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:45.619694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4f0b-af8c-4f21-b67b-1eae5a4e0576 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:45.620017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4f0b-af8c-4f21-b67b-1eae5a4e0576 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:45.620292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b4f0b-af8c-4f21-b67b-1eae5a4e0576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:45.694932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2e7b4f0b-af8c-4f21-b67b-1eae5a4e0576 None None] MFA Rules not processed for user `b6621711a3aa475fad33e482bd096989`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:45.696152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e7b4f0b-af8c-4f21-b67b-1eae5a4e0576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:45.715579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:45.769468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 740/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Sep 23 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:45.777237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:45.778800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:45.881263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf59cc-1cf7-4708-a67a-ac4eec29083b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:45.954002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:45.954608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:45.954891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:45.955165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:45.956810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:46.011195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:46.065098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:46.066572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e8098-bf40-4961-8724-cb3893ca25bf service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:46.084631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 735/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 13:54:48.319115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:48.319689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:48.319689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:48.321019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 741/1476] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:48.326433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf351e7-958a-4576-a15d-5492e06681e0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:48.326878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf351e7-958a-4576-a15d-5492e06681e0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:48.327023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf351e7-958a-4576-a15d-5492e06681e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:48.391892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9cf351e7-958a-4576-a15d-5492e06681e0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:48.393140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9cf351e7-958a-4576-a15d-5492e06681e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:48.488782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 736/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:48.765692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:48.767250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:48.888272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e910e-d75d-4e3f-9012-420c5719ee94 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:48.937247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:48.980682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:48.981292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:48.981572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:48.981845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:48.982481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:48.984284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:54:48.984284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 13:54:48.984284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 13:54:48.985420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9bf9a-d134-4cb1-94b4-dac6509537f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:49.004768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 742/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Sep 23 13:54:48 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:54:51.163577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:51.164201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:51.164201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:51.165568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 737/1479] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:51.171028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642977-ad60-47cd-822a-77aaca1d7e4d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:51.171461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642977-ad60-47cd-822a-77aaca1d7e4d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:51.171572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9642977-ad60-47cd-822a-77aaca1d7e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:51.236463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9642977-ad60-47cd-822a-77aaca1d7e4d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:51.237691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9642977-ad60-47cd-822a-77aaca1d7e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:51.333129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 743/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:51.630973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:51.632518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:51.642072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:51.776196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec3eb5-997f-4097-9d11-b8c71bc7abfc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:51.855928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:51.888250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:51.888859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:51.889133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:51.889400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:51.890992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:51.981942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:51.983533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed437a6-9520-473f-894b-6f3eb086ebd4 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:52.002165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 738/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:54.317247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:54.317791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:54.317791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:54.319156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 744/1482] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:54.324508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd04018-7b07-4bdd-86a1-c193c5abf0a9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:54.325006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd04018-7b07-4bdd-86a1-c193c5abf0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:54.325111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd04018-7b07-4bdd-86a1-c193c5abf0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:54.390141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-acd04018-7b07-4bdd-86a1-c193c5abf0a9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:54.391367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-acd04018-7b07-4bdd-86a1-c193c5abf0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:54.436379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.486564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 739/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:54.773104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:54.774635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:54.798030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:54.875696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75533d1-0b63-4989-bc00-98a167d12f06 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:54.947212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:54.947743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:54.948055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:54.948324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:54.949916 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:55.023526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:55.057918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:55.059353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8cb619-f18a-4aea-9fe6-5c1c41313324 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:55.077196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 745/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:54:57.260771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:57.261365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:57.261365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:57.262758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 740/1485] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:54:57.268010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3fe7a-1e88-46cb-8dbd-881696d275b2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:57.268418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3fe7a-1e88-46cb-8dbd-881696d275b2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:57.268564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3fe7a-1e88-46cb-8dbd-881696d275b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:57.333477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b2c3fe7a-1e88-46cb-8dbd-881696d275b2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:54:57.334693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b2c3fe7a-1e88-46cb-8dbd-881696d275b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:57.428792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 746/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:54:57.720111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:54:57.721651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:57.826251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527d37f-65a6-4c7b-885f-26dcdada350d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:54:57.899197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:54:57.900658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:54:57.901410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:54:57.901690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:54:57.901963 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:54:57.903579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:54:58.010686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:54:58.012150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae17b8-d336-442f-a3a6-d4e2cb0bb158 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:54:58.030550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 741/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:00.255054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:00.255594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:00.255594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:00.257008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 747/1488] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:55:00.262247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f280-a97f-4f04-943d-806643b9827c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:00.262674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f280-a97f-4f04-943d-806643b9827c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:00.262797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f280-a97f-4f04-943d-806643b9827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:00.328571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2c31f280-a97f-4f04-943d-806643b9827c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:55:00.329804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2c31f280-a97f-4f04-943d-806643b9827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:00.381470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:00.424287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 742/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:55:00.715878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:55:00.717489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:00.752429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:00.819073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02be15-82e8-4694-8624-b2b8a1819a25 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:55:00.890717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:55:00.891317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:00.891596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:00.891865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:00.893487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:00.972325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:01.001206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:55:01.002640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbdc45-2e5b-415a-9984-d661d1548339 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:55:01.021789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 748/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:03.516846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:03.517425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:03.517425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:03.518729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 743/1491] 10.222.0.48 () {54 vars in 927 bytes} [Fri Sep 23 13:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:55:03.524422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a95a-61d7-49b8-8106-ab780eb73983 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:03.524832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a95a-61d7-49b8-8106-ab780eb73983 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:03.524966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2575a95a-61d7-49b8-8106-ab780eb73983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:03.588769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2575a95a-61d7-49b8-8106-ab780eb73983 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:55:03.589953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2575a95a-61d7-49b8-8106-ab780eb73983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:03.683790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 749/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Fri Sep 23 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:55:03.970103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:55:03.971665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:04.074728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a79f3-076b-4b84-95e4-1d014c58dfe5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:55:04.146816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:55:04.147422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:55:04.147706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:55:04.148014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:55:04.149615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:55:04.158027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:04.258717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:55:04.260191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52733cb-6b95-471d-858f-a509d40f72f0 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:55:04.278302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 744/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:55:13.682292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:55:14.276067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=50 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:40.727406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:40.727900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:40.728052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:40.802603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:56:40.803803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:40.895758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 750/1494] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:56:40.904569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:40.905055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:40.905173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:40.979765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:56:40.981009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:41.075701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 745/1495] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:56:41.080261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:41.081469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:41.093373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52f888-b77a-4eae-8563-b8fde55193b6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:41.153365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:41.185878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:41.186478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:41.186755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:41.187024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:41.187909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 13:56:41.188238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:41.189251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:41.189251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 13:56:41.189251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 13:56:41.190158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:41.201422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 751/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 13:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:56:41.210418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:41.219448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32393b2f-b5af-4425-a1b3-63eecb5911cf None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:41.280773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:41.314247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:41.314857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:41.315135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:41.315405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:41.316092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:41.317820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:41.317820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 13:56:41.317820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 13:56:41.319022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:41.456908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 746/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 13:56:41 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:56:41.461719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:41.463315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:41.497054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a413d4-13d4-4b5d-9b64-d4cfc4606646 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:41.588590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:41.589118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:41.589392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:41.589659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:41.590268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:41.591273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:41.591273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 13:56:41.591273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 13:56:41.592485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:41.684618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 752/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 13:56:41 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 13:56:41.689061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:41.690600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:41.756328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3992-4e28-44f9-aeba-104b412d157f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:41.841781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:41.852167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:41.852787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:41.853065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:41.853335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:41.853979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:41.855080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:41.855080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 13:56:41.855080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 13:56:41.855903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:41.869079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 747/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:56:41.878757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:41.880433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:41.893547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f1b8a-346e-407e-9046-1b57027818dd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:41.918114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:41.985211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:41.985816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:41.986126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:41.986396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:41.987026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:41.988065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:41.988065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 13:56:41.988065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 13:56:41.988946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fc8b5-02f6-40ba-a38b-9524da2411a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:42.001437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 753/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 13:56:42.005571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:42.007108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.039203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b4c7-aa3c-4ebc-bbb1-0ced97146aaf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:42.137433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:42.138013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.138289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.138557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] PATH_INFO: `/v3/projects/6d93e975208544abbc2873751747469d/users/05d6dc119fbd4ea2a087f5a08d6a2178/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.160656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d93e975208544abbc2873751747469d, user_id=05d6dc119fbd4ea2a087f5a08d6a2178, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:42.161677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:42.161677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 13:56:42.161677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 13:56:42.164203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130909c-c301-4b5b-a80a-927c7e0eb8f3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:42.229503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 748/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 13:56:42 2022] PUT /identity/v3/projects/6d93e975208544abbc2873751747469d/users/05d6dc119fbd4ea2a087f5a08d6a2178/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:56:42.241581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bb60-a436-4d4e-8e3f-0a287e35d8a0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.241889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bb60-a436-4d4e-8e3f-0a287e35d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.242152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124bb60-a436-4d4e-8e3f-0a287e35d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.298001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0124bb60-a436-4d4e-8e3f-0a287e35d8a0 None None] MFA Rules not processed for user `05d6dc119fbd4ea2a087f5a08d6a2178`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:56:42.299198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0124bb60-a436-4d4e-8e3f-0a287e35d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.374203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 754/1502] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:56:42.387629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.387855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.388157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.389495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 749/1503] 10.222.0.48 () {54 vars in 963 bytes} [Fri Sep 23 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:56:42.394352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3029-90d8-4e04-8f62-ac905ce29fb1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.394632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3029-90d8-4e04-8f62-ac905ce29fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.394900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f3029-90d8-4e04-8f62-ac905ce29fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.426298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:42.471399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a47f3029-90d8-4e04-8f62-ac905ce29fb1 None None] MFA Rules not processed for user `983535804007417db2c2f7727e70cda7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:56:42.472714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a47f3029-90d8-4e04-8f62-ac905ce29fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.545715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 755/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Sep 23 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:56:42.553372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:42.554900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.604318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:42.656256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacc1ecf-434f-4c04-8167-974c82e4c7cb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:42.729600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:42.730214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.730501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.730774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.732403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.829734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:42.831150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:42.835197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:42.848783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 750/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:56:42.893206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b2c78-bbd7-441e-b9f5-63441f526b58 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:42.893607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b2c78-bbd7-441e-b9f5-63441f526b58 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:42.893750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b2c78-bbd7-441e-b9f5-63441f526b58 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:42.895005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 756/1506] 10.222.0.48 () {52 vars in 830 bytes} [Fri Sep 23 13:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:56:42.899186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:42.900449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:42.996594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69a31e-454c-4ce1-9b16-961267e91825 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:43.087479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:43.088149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:43.088399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:43.088664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] PATH_INFO: `/v3/users/05d6dc119fbd4ea2a087f5a08d6a2178` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:43.101074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d6dc119fbd4ea2a087f5a08d6a2178)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:43.102107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:43.102107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 13:56:43.102107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 13:56:43.103353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:43.112756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:43.296229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d6dc119fbd4ea2a087f5a08d6a2178'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:43.366620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d6dc119fbd4ea2a087f5a08d6a2178'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:43.367056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d6dc119fbd4ea2a087f5a08d6a2178'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:43.367577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d6dc119fbd4ea2a087f5a08d6a2178'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:43.382652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d6dc119fbd4ea2a087f5a08d6a2178'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:43.412835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 751/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 13:56:42 2022] DELETE /identity/v3/users/05d6dc119fbd4ea2a087f5a08d6a2178 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:56:43.417234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:43.417520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:43.417839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:43.474107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:56:43.475823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:43.549763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:43.561257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 757/1508] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:56:43.572234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:43.573472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:43.674306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513561ad-fece-4901-9b96-70289e2b7177 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:43.728763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:43.747908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:43.748586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:43.748975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:43.749501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:43.751084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:43.860337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:43.861783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346370a9-3026-4131-b6f6-cd3ddfb4d67d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:43.880068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 752/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:56:44.340493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:56:44.341786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:56:44.353920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d4f5-1cc1-437e-a1ee-9f96a763e6c4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:56:44.450933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:56:44.451561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:56:44.451838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:56:44.452136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] PATH_INFO: `/v3/projects/6d93e975208544abbc2873751747469d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:56:44.461788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d93e975208544abbc2873751747469d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:56:44.462819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 13:56:44.462819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 13:56:44.462819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 13:56:44.464044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:56:44.593985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d93e975208544abbc2873751747469d', 'request_id': 'req-49cbe9af-e599-4d32-9589-f2d0f15a4840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:44.600764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d93e975208544abbc2873751747469d', 'request_id': 'req-49cbe9af-e599-4d32-9589-f2d0f15a4840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:44.646591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d93e975208544abbc2873751747469d', 'request_id': 'req-49cbe9af-e599-4d32-9589-f2d0f15a4840'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:44.678047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] The token cache is being invalidate because project 6d93e975208544abbc2873751747469d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 13:56:44.678336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:44.678775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-49cbe9af-e599-4d32-9589-f2d0f15a4840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 13:56:44.680216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 758/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 13:56:44 2022] DELETE /identity/v3/projects/6d93e975208544abbc2873751747469d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 13:56:53.877840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=62 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:56:54.676875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:58:21.205155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415360c-e745-46ca-8520-9646dcab572a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:21.205717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415360c-e745-46ca-8520-9646dcab572a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:21.205717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415360c-e745-46ca-8520-9646dcab572a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:21.206968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:21.211871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8728e-d725-42ff-a621-cdb77fe47014 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:21.212392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8728e-d725-42ff-a621-cdb77fe47014 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:21.212496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8728e-d725-42ff-a621-cdb77fe47014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:21.291196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9ed8728e-d725-42ff-a621-cdb77fe47014 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:21.292422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ed8728e-d725-42ff-a621-cdb77fe47014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:21.393884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:21.547815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415360c-e745-46ca-8520-9646dcab572a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:21.550067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a415360c-e745-46ca-8520-9646dcab572a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:21.667679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415360c-e745-46ca-8520-9646dcab572a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:21.673015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:21.673611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:21.673887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:21.674157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:21.681880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:21.683478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5511d1-f4a3-4a7d-97a3-9abf5e80fe60 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:21.693142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 754/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:22.783039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dc37-d775-47b5-beab-4a9d94a7a737 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:22.783545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dc37-d775-47b5-beab-4a9d94a7a737 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:22.783643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09dc37-d775-47b5-beab-4a9d94a7a737 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:22.785022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:22.791386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883085-a822-4d6a-a047-6c7775bd7985 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:22.791837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883085-a822-4d6a-a047-6c7775bd7985 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:22.792004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10883085-a822-4d6a-a047-6c7775bd7985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:22.811714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-10883085-a822-4d6a-a047-6c7775bd7985 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:22.812971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-10883085-a822-4d6a-a047-6c7775bd7985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:22.821711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:22.972871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09dc37-d775-47b5-beab-4a9d94a7a737 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:22.987282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09dc37-d775-47b5-beab-4a9d94a7a737 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:22.993315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:22.993924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:22.994200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:22.995099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:23.003558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:23.005173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ef6bd-57c9-4740-bc65-1c68c047d4dd service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:23.015153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 761/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:23.028232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809cea-10ed-4e37-ba87-d5a992922dfc None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:23.028590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809cea-10ed-4e37-ba87-d5a992922dfc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:23.028967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809cea-10ed-4e37-ba87-d5a992922dfc None None] PATH_INFO: `/v3` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:23.030247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 756/1517] 10.222.0.64 () {54 vars in 925 bytes} [Fri Sep 23 13:58:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 13:58:23.036225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3db3-d50c-412a-ba7c-ffdf9cdc1416 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:23.036515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3db3-d50c-412a-ba7c-ffdf9cdc1416 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:23.036791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3db3-d50c-412a-ba7c-ffdf9cdc1416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:23.102448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-329c3db3-d50c-412a-ba7c-ffdf9cdc1416 None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:23.103710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-329c3db3-d50c-412a-ba7c-ffdf9cdc1416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:23.121989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:58:23.178189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 762/1518] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Sep 23 13:58:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:26.889138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54712-8eb7-421d-87c7-019389d2b45b None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:26.891546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54712-8eb7-421d-87c7-019389d2b45b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:26.891546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54712-8eb7-421d-87c7-019389d2b45b None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:26.891546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 757/1519] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 13:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:26.895869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339ae-44e9-40e0-967f-670de3f36e84 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:26.896382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339ae-44e9-40e0-967f-670de3f36e84 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:26.896863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88339ae-44e9-40e0-967f-670de3f36e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:26.921121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c88339ae-44e9-40e0-967f-670de3f36e84 None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:26.922315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c88339ae-44e9-40e0-967f-670de3f36e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:26.930702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 763/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:26.938251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54712-8eb7-421d-87c7-019389d2b45b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:26.952561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54712-8eb7-421d-87c7-019389d2b45b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:26.957454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:26.958068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:26.958350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:26.958625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:26.967439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:26.969080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e0a01-4305-410b-99f6-132d20c38069 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:26.978548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 758/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:34.480924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f39-4adb-402a-b2c2-cc4e413d00bd None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:34.481402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f39-4adb-402a-b2c2-cc4e413d00bd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:34.481498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f4f39-4adb-402a-b2c2-cc4e413d00bd None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:34.482811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:34.489072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4932ff5-f344-45bc-85bc-f974aec0b193 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:34.489517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4932ff5-f344-45bc-85bc-f974aec0b193 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:34.489627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4932ff5-f344-45bc-85bc-f974aec0b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:34.508674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c4932ff5-f344-45bc-85bc-f974aec0b193 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:34.510386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c4932ff5-f344-45bc-85bc-f974aec0b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:34.518146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:34.671877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4f39-4adb-402a-b2c2-cc4e413d00bd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:34.686693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f4f39-4adb-402a-b2c2-cc4e413d00bd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:34.692391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:34.692992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:34.693280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:34.693553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:34.702269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:34.703934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29189-cbc4-4531-bcf5-8d1f14508e9e service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:34.713289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 765/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:35.772091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2fe4-b91f-42dd-be6c-f4eb040aa487 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:35.772665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2fe4-b91f-42dd-be6c-f4eb040aa487 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:35.772665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2fe4-b91f-42dd-be6c-f4eb040aa487 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:35.773987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 23 13:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:35.780535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a74f7-1094-43a3-90f1-a6b5e45499ed None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:35.780944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a74f7-1094-43a3-90f1-a6b5e45499ed None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:35.781079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a74f7-1094-43a3-90f1-a6b5e45499ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:35.801072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-943a74f7-1094-43a3-90f1-a6b5e45499ed None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:35.802262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-943a74f7-1094-43a3-90f1-a6b5e45499ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:35.810049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 23 13:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:35.959306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2fe4-b91f-42dd-be6c-f4eb040aa487 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:35.973925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2fe4-b91f-42dd-be6c-f4eb040aa487 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:35.979252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:35.979849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:35.980154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:35.980424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:35.988278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:35.989850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60549519-64c7-43db-97a6-59d3aff6a691 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:35.998840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 761/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:40.047339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:40.048008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:40.048008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:40.049272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:40.054563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d51b-28d0-452b-9c69-cf82cfc4542a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:40.055005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d51b-28d0-452b-9c69-cf82cfc4542a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:40.055122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2d51b-28d0-452b-9c69-cf82cfc4542a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:40.075358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-95b2d51b-28d0-452b-9c69-cf82cfc4542a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:40.076593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95b2d51b-28d0-452b-9c69-cf82cfc4542a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:40.084629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:40.371017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:40.372789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:40.450488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706876b6-3e2a-4981-b582-d6123dcaf66b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:40.454103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:40.454713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:40.454996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:40.455277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:40.465597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:40.467053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd9e16-71d6-4e0c-a1a0-4ff44c0c04eb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:40.477940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 768/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:42.609434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76bed5-3dd0-4703-869a-5e78cd162027 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:42.609987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76bed5-3dd0-4703-869a-5e78cd162027 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:42.609987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb76bed5-3dd0-4703-869a-5e78cd162027 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:42.611356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:42.616716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b6ddb-509b-4a11-bc2f-d4ce968b245a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:42.617160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b6ddb-509b-4a11-bc2f-d4ce968b245a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:42.617265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b6ddb-509b-4a11-bc2f-d4ce968b245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:42.637321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-950b6ddb-509b-4a11-bc2f-d4ce968b245a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:42.638523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-950b6ddb-509b-4a11-bc2f-d4ce968b245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:42.646640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:42.941681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76bed5-3dd0-4703-869a-5e78cd162027 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:42.952965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb76bed5-3dd0-4703-869a-5e78cd162027 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:42.956474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:42.957076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:42.957356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:42.957630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:42.966684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:42.968152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac5b22a-8e70-4c4c-a0a2-4a6a72ec292b service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:42.977417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 764/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:46.797794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:46.798268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:46.798375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:46.799682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:46.805104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8534d3-90bc-4eaf-9c03-574f6272abe5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:46.806037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8534d3-90bc-4eaf-9c03-574f6272abe5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:46.806154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8534d3-90bc-4eaf-9c03-574f6272abe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:46.813899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=81 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:58:46.827605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6a8534d3-90bc-4eaf-9c03-574f6272abe5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:46.831072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6a8534d3-90bc-4eaf-9c03-574f6272abe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:46.836737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:47.141980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:47.143648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:47.206679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:58:47.220677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea654b-05ea-42c7-8a38-089e116012c1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:47.224273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:47.224876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:47.225157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:47.225432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:47.234350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:47.235774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05a7ec-7e74-4203-8642-5dc8c36899c3 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:47.245220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 771/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:49.385134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:49.385711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:49.385711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:49.387194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 23 13:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 13:58:49.392393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94e0b-7c93-4f05-875f-27200c6e990e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:49.392811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94e0b-7c93-4f05-875f-27200c6e990e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:49.392955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab94e0b-7c93-4f05-875f-27200c6e990e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:49.412244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4ab94e0b-7c93-4f05-875f-27200c6e990e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 13:58:49.413452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ab94e0b-7c93-4f05-875f-27200c6e990e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:49.421815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 23 13:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 13:58:49.726283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 13:58:49.736921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 13:58:49.741363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51ebe2-e42b-4104-abb1-d106c2821c2a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 13:58:49.744900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 13:58:49.745486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 13:58:49.745820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 13:58:49.746058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 13:58:49.754794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 13:58:49.756275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706a487-03c5-43bf-9ee0-35f7eb79813e service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 13:58:49.765601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 767/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 13:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 13:58:59.407424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=11 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 13:58:59.761403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=8 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:17.106956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e20e-6d77-4d33-96c2-3d364fa95dae None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.107583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e20e-6d77-4d33-96c2-3d364fa95dae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.107583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428e20e-6d77-4d33-96c2-3d364fa95dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.132255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9fa59-d16b-4e4b-afe6-6a859f8a6160 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.132866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9fa59-d16b-4e4b-afe6-6a859f8a6160 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.132866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9fa59-d16b-4e4b-afe6-6a859f8a6160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.136266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7428e20e-6d77-4d33-96c2-3d364fa95dae None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.137540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7428e20e-6d77-4d33-96c2-3d364fa95dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.152841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 773/1540] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:17.161858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.162154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.162436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.164504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b8a9fa59-d16b-4e4b-afe6-6a859f8a6160 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.165867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8a9fa59-d16b-4e4b-afe6-6a859f8a6160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.179606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 768/1541] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:17.192395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.192685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.192971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.197206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.199159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.211858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 774/1542] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:17.216721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.223666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.227055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.231129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280caa2-2492-4048-a6b0-4c2766dfaaaa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.240823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 769/1543] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:17.241045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.241687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.241970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.242243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.242908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:17.243210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.247359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.248259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.258469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac2429-6e97-48c4-a76b-5bed5fc6823e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.266310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 775/1544] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:00:17.273912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.274348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.274634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.274910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.275145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.275720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:17.276061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.277178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:17.277178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 14:00:17.277178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 14:00:17.278088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.294530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66122809-9651-41f2-b89b-d113cefef515 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.301337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 770/1545] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:00:17.303393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.304037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.304318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.304587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.305225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.306245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:17.306245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 14:00:17.306245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 14:00:17.308120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c0304-cb9a-4c14-97eb-b0a261450a66 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.309906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.325414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418965-5a95-46d2-9b25-9311e19bcfe7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.337734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.338406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.338692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.338968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.339615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.341951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd04623-f3c6-4e5d-ab73-643336ce51a4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.457797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 776/1546] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:17.459538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ee4e-b8e2-41ee-a846-f2947f4c6dac None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.460150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ee4e-b8e2-41ee-a846-f2947f4c6dac None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.460690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379ee4e-b8e2-41ee-a846-f2947f4c6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.481580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9379ee4e-b8e2-41ee-a846-f2947f4c6dac None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.482787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9379ee4e-b8e2-41ee-a846-f2947f4c6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.515307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 771/1547] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/projects => generated 405 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:17.515307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273b8b-4193-4fa9-9acc-a8c2e349c333 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.516417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273b8b-4193-4fa9-9acc-a8c2e349c333 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.516417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a273b8b-4193-4fa9-9acc-a8c2e349c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.536582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0a273b8b-4193-4fa9-9acc-a8c2e349c333 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.537839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0a273b8b-4193-4fa9-9acc-a8c2e349c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.552174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 777/1548] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.553442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.553738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.554017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.574520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.575733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.600298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 772/1549] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.602479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec018b-ba66-4d0a-adcb-25733c03b961 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.602479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec018b-ba66-4d0a-adcb-25733c03b961 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.602479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aec018b-ba66-4d0a-adcb-25733c03b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.622973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6aec018b-ba66-4d0a-adcb-25733c03b961 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.624331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6aec018b-ba66-4d0a-adcb-25733c03b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.632411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 773/1550] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.633696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2918fc-bae0-46f8-8633-3a4e2aebd398 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.633982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2918fc-bae0-46f8-8633-3a4e2aebd398 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.634259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2918fc-bae0-46f8-8633-3a4e2aebd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.645927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 778/1551] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.646758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.653875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5a2918fc-bae0-46f8-8633-3a4e2aebd398 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.655067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5a2918fc-bae0-46f8-8633-3a4e2aebd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.661102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2917-bc06-4d9b-9eda-de33bb2b3f06 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.663026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 774/1552] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.664278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.664567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.664842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.672905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.673532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.673804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.674075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.674710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.676681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61018-547e-411c-ac13-c8eec226faac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.685021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.686218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.694367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 775/1553] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.694945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.704273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c51c0a-2480-42da-8e93-520032d0b316 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.708925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.709449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.709728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.710003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.710632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.711703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:17.711703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 14:00:17.711703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 14:00:17.712943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068df4d-6909-4952-a413-5f6e911f71cd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.783765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 779/1554] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:17.783765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304e2a-45a4-40ab-a57e-bf9ae7c15013 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.783765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304e2a-45a4-40ab-a57e-bf9ae7c15013 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.783765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca304e2a-45a4-40ab-a57e-bf9ae7c15013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.803479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca304e2a-45a4-40ab-a57e-bf9ae7c15013 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.804728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca304e2a-45a4-40ab-a57e-bf9ae7c15013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.809207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 776/1555] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:17.812517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f6fb-f4d3-4784-a2fa-3cbce7d6e95d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.812517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f6fb-f4d3-4784-a2fa-3cbce7d6e95d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.812517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169f6fb-f4d3-4784-a2fa-3cbce7d6e95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.814425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 780/1556] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.817299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1955c3-8ecc-4144-82f3-f666c925c924 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.817669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1955c3-8ecc-4144-82f3-f666c925c924 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.818025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1955c3-8ecc-4144-82f3-f666c925c924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.830512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6169f6fb-f4d3-4784-a2fa-3cbce7d6e95d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.831730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6169f6fb-f4d3-4784-a2fa-3cbce7d6e95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.839875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd1955c3-8ecc-4144-82f3-f666c925c924 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.840273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 777/1557] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.841078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd1955c3-8ecc-4144-82f3-f666c925c924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.841460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c771f-5247-4bf5-8825-d6466fe50edc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.841744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c771f-5247-4bf5-8825-d6466fe50edc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.842022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c771f-5247-4bf5-8825-d6466fe50edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.849433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 781/1558] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.850612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.850894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.851167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.865020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4d1c771f-5247-4bf5-8825-d6466fe50edc None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.866226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d1c771f-5247-4bf5-8825-d6466fe50edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.871098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.872366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.874488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 778/1559] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.875762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.876155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.876507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.883891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 782/1560] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.885100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.896098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa06fe-75f3-45f4-8196-e1c81b38ddab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.897168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:17.898427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:17.901355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.901955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.902236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.902511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.903144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.904770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.906210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:17.906954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 779/1561] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:17.907551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.917171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4eeed-0227-45ff-856a-d568b0a9c948 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.919847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 783/1562] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:17.920734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.924302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.924914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.925193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.925462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.926105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.927737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.930590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41982-29df-467f-bfd4-a9869bdff819 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.935276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.935864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.936177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.936456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.937095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:17.937405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.941910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 780/1563] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:17.942070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.942191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.949958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c17d66-f8c4-424f-87b2-c1e854c94416 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.951574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 784/1564] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:17.952583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.961938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.961938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.961938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.961938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.962341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:17.962341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.962699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d8b60-4697-4f42-a973-023992682687 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.964057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.967831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:17.968458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:17.968743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:17.969018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:17.969679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:17.969987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:17.971567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:17.977651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 781/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:17.978704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.990046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 785/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:17.990046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:17.994957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d7de0-f7de-462f-b529-1d4ea1ba4b3c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.995386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eabcf7f-68f9-4880-a9de-b75ac96206d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:17.999425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.000074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.000215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.000364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.000635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.000976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.001261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.001365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:18.001538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.001647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.002169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:18.002471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.003131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.004059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.014806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 782/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:18.015594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.016361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 786/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:18.017238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.025239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015ccf8-968b-408e-ab5d-d4dffc96f26c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.028457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f326fc-af16-427c-8acb-54bf0a95e8c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.030413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.031005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.031300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.031559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.032211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:18.032527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.033346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.033945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.034093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.034247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.034504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.035165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.036926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.046598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 783/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:18.047395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.048934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 787/1570] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:18.049898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.053628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:18.057726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5da282-77b4-4b54-aa6e-e33c5cb2d2b1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.061965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702167ac-482c-43e4-81d0-a8a8f315e146 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.064078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.064078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.064078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.064078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.064497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.065966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.067356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.067971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.068254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.068526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.069148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.071031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.076610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 784/1571] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:18.077366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.089950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ef54d-393c-4818-8579-083f8079a926 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.094691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.096914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.096914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.096914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.096914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.098623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.196320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 788/1572] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.196320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.222288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 785/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.223170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.256888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a123b91-8cf3-4f80-9c80-3a094ce22896 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.287416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2e258-4304-4038-aaa6-13e0ff929911 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.292444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.293049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.293327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.293595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.294221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.296143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.316197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.316810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.317087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.317432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.318033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.320010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.398951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 786/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.399868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.422160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 789/1575] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.423010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.444440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:18.463991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee89221-bf3a-4a43-91e4-01dcac78863a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.489829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a0e12d-4a1d-4ed4-9661-fb8ddcbfaff7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.495068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.495729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.496113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.496312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] PATH_INFO: `/v3/projects/99fde9f47a1f41b695cbf021340bfb65/users/57e6a1e99a7c4dfd922299028a4ea809/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.511458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99fde9f47a1f41b695cbf021340bfb65, user_id=57e6a1e99a7c4dfd922299028a4ea809, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.514203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:18.514203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 14:00:18.514203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 14:00:18.514520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.520092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.520708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.520986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.521260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.521889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.523790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.533294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:18.613877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 790/1576] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:18 2022] PUT /identity/v3/projects/99fde9f47a1f41b695cbf021340bfb65/users/57e6a1e99a7c4dfd922299028a4ea809/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:18.614669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.645314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 787/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 385 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.646332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.679587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49b7bd-a6dd-4a01-ba35-7e1cb6f9f132 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.715143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313096c-d485-491f-ad32-04b8b8536b25 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.721389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.722182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.722517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.722882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] PATH_INFO: `/v3/projects/841e0559b3a748e4b65fe46090402d2c/users/546deeefe5724d1281d4119652e4e301/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.742086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841e0559b3a748e4b65fe46090402d2c, user_id=546deeefe5724d1281d4119652e4e301, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.745302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.754145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.754755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.755031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.755299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.755993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.757907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.837136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 788/1578] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:18 2022] PUT /identity/v3/projects/841e0559b3a748e4b65fe46090402d2c/users/546deeefe5724d1281d4119652e4e301/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:18.838015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.862262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 791/1579] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:18.863548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:18.897398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:18.901241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35614f5-08d3-4b30-b8f3-6ea1ada79c79 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.924910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b1092-f933-42dd-b453-2cc2f127572f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:18.929614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.930221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.930504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.930783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.932675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.934597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:18.959493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:18.960132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:18.960421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:18.960697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:18.961325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:18.963291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.069409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 789/1580] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.069409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.069705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 792/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:18 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.069705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.076891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0f46a-8667-498f-8f85-084688d8f7a3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.079264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2fa4c-9493-479d-970d-94ced94cad2f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.081547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.082141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.082425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.082700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.083318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.084490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.085085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.085296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.085394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.085624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.086271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.088365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc4eb5-d5a3-4a5f-89e5-9df4d365567a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.094436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:19.177729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 793/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.177923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 790/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.177923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.178097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca297ca-5dd6-4808-b0e9-59581aee8a9d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.178097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca297ca-5dd6-4808-b0e9-59581aee8a9d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.178097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca297ca-5dd6-4808-b0e9-59581aee8a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.188135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16e6c5-ef8a-4844-8fec-aaef8c48bcdb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.193074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.193838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.194148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.194419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.195045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.196527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5ca297ca-5dd6-4808-b0e9-59581aee8a9d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:19.197043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.197739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5ca297ca-5dd6-4808-b0e9-59581aee8a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:19.205508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 794/1584] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:19.206700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.208427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.208427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.236199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] MFA Rules not processed for user `546deeefe5724d1281d4119652e4e301`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:19.237405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:19.271878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 791/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.272721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.283107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102018f0-a3cb-4dae-b5bc-66c5a3b901f3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.288323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.288925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.289313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.289613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.290231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.292909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.304978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 795/1586] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:19.305820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.316013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3054e759-34b4-42c9-bec6-21e709b51059 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.320757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.321312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.321589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.321857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.322480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.324110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.333700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 796/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.334452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.346274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204db7f-3c9e-4172-8a91-e111123e7a21 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.350855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.351428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.351706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.352009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.352620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.354834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.364370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 797/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.365137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.374136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d74e9-0306-4d02-9b88-16c8e5d104d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.378639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.379191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.379472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.379745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.380383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.381902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.391739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 798/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.392523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.401966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfb291-caaa-4c26-928f-116964c51e03 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.406454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.406998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.407278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.407548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.408166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.409683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.418230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 792/1590] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.418230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.422839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 799/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.422839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.430467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67997ac-d26e-4e0e-b6f2-f62a778582de admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.435062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.435648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.435958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.436233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.436857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.438443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.448450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 800/1592] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.449243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.458712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d5805-6fe3-4dfd-8d9e-c0b830592efd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.463948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.464557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.464837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.465462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.465723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.467630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.488249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6f46-1020-437c-9c94-270de6ca3409 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.491758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.492416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.494280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.494280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.501772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.503248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.512729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 793/1593] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:19.513524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.522392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74423433-dfd8-4055-b573-0e4f2821df6c service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.528024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.528614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.528900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.529175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.529802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.531376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.542180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 794/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.546068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.548066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 801/1595] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.549073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.554695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9baf14-bae0-43c9-af88-799426ce24de admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.560753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:19.613396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.613805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae4081-be06-47a7-9d9b-39b9b176621d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.613978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.614257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.614526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.615187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.616829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.618451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.619107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.619389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.619661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.620414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.621938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.628694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 795/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.629767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.635328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 802/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.636249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.644657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e7dc8-4f23-4182-a972-dd09e939a57a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.651276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602410e8-d882-4d6e-88af-fe93526619d1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.651453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.651453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.651453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.651453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.652028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.653556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.653693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.654161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.654444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.654718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.655880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.657586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.665033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 796/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.665920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.669154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 803/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.669842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.677431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c760f-595f-4893-a1ab-66fce5599342 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.680223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6371fbc-3f9c-459e-a5f9-461d166537cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.684837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.685001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.685495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.685670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.685790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.685944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.686100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.686203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] PATH_INFO: `/v3/projects/4b78056f50354b469c6d5a3a981682d4/users/1703c74bd9fc41b7a9f89a6380c5902b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.686776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.688479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.700243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 797/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:19.701100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.708112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b78056f50354b469c6d5a3a981682d4, user_id=1703c74bd9fc41b7a9f89a6380c5902b, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.711082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.714257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e924a-9ae2-4922-92d4-8adb322ae186 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.719103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.719842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.720164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.720432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.721064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.722966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.791511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 804/1601] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:19 2022] PUT /identity/v3/projects/4b78056f50354b469c6d5a3a981682d4/users/1703c74bd9fc41b7a9f89a6380c5902b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:19.792354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.821776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 798/1602] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:19 2022] POST /identity/v3/users => generated 308 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:19.823122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:19.832431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:19.836740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d2fb-5ffb-4845-b0d4-b4f28f3a1efb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.864824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9086869-aab9-4fa6-b558-86a58d3d8a8d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:19.869914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.870675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.870843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.871109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] PATH_INFO: `/v3/projects/b854fc8776dd4f568ed0fdd6320014b3/users/f6ded13ce6624dc4b23f156c03e55f8e/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.893640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b854fc8776dd4f568ed0fdd6320014b3, user_id=f6ded13ce6624dc4b23f156c03e55f8e, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.897304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:19.910733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:19.911404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:19.911700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:19.911986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] PATH_INFO: `/v3/projects/7f0f1dd8210f448691af52e760578493/users/7b6d41c5989443b0954a147afd3b0417/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:19.927117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0f1dd8210f448691af52e760578493, user_id=7b6d41c5989443b0954a147afd3b0417, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:19.932333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.020622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 805/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:19 2022] PUT /identity/v3/projects/b854fc8776dd4f568ed0fdd6320014b3/users/f6ded13ce6624dc4b23f156c03e55f8e/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.021662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.033443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 799/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:19 2022] PUT /identity/v3/projects/7f0f1dd8210f448691af52e760578493/users/7b6d41c5989443b0954a147afd3b0417/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.034384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.076267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:20.087834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e360d-89c7-419a-8ad8-ec75db433031 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.098077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50409df-5005-4314-a944-e9cbad2400cf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.103060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.103735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.104050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.104331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] PATH_INFO: `/v3/projects/b8dde4afd11f4a8387f7391e3b0b8b95/users/47aa5cf320134658b77c2fc5e4debcde/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.120873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dde4afd11f4a8387f7391e3b0b8b95, user_id=47aa5cf320134658b77c2fc5e4debcde, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.123473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88755c54-4a81-4a3b-bbce-7353d9300df6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.147475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.148128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.148408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.148681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.149321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.150962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.160640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 806/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:20.161516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.171277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b0281-a9a0-43eb-8645-875b58c2b93e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.175910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.176570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.176852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.177179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] PATH_INFO: `/v3/projects/7c8e0d1aeb50401b85c2e2e3a0552ae2/users/bc7fd21870f94086a6a0325650a49d3f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.193130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8e0d1aeb50401b85c2e2e3a0552ae2, user_id=bc7fd21870f94086a6a0325650a49d3f, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.195871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.220920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 800/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:20 2022] PUT /identity/v3/projects/b8dde4afd11f4a8387f7391e3b0b8b95/users/47aa5cf320134658b77c2fc5e4debcde/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.231456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47ef4-4301-436a-8b53-8a11428cf981 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.231902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47ef4-4301-436a-8b53-8a11428cf981 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.232234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e47ef4-4301-436a-8b53-8a11428cf981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.267557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-32e47ef4-4301-436a-8b53-8a11428cf981 None None] MFA Rules not processed for user `1703c74bd9fc41b7a9f89a6380c5902b`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:20.268854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-32e47ef4-4301-436a-8b53-8a11428cf981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.300881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 807/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:20 2022] PUT /identity/v3/projects/7c8e0d1aeb50401b85c2e2e3a0552ae2/users/bc7fd21870f94086a6a0325650a49d3f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.301897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.333191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:20.337036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 801/1608] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:20.340667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2001b2-abba-4032-ba40-fd7d94cacbca None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.340957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2001b2-abba-4032-ba40-fd7d94cacbca None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.341230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2001b2-abba-4032-ba40-fd7d94cacbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.368766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a304c9-3e60-4b8f-ad22-ce68888b0f85 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.374354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.374914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.375198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.375474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.376151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.377775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b394768-d7e0-439f-a428-543c83f0efa9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.380764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fe2001b2-abba-4032-ba40-fd7d94cacbca None None] MFA Rules not processed for user `f6ded13ce6624dc4b23f156c03e55f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:20.382043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fe2001b2-abba-4032-ba40-fd7d94cacbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.388394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 808/1609] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:20.389677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.389967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.390247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.409627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:20.411168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.422157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 809/1610] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:20.422749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.438460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae265a8f-09ee-44ed-a3f3-ee28bbab1701 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.443895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.444824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.445017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.445292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] PATH_INFO: `/v3/projects/ca11299035ae4372a617680c28b177c2/users/536665d6dadd4b7d9e38080eb1c85101/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.468076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 802/1611] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:20.470471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0649a-f818-448d-ad56-733f57220d82 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.471217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0649a-f818-448d-ad56-733f57220d82 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.471217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0649a-f818-448d-ad56-733f57220d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.474496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca11299035ae4372a617680c28b177c2, user_id=536665d6dadd4b7d9e38080eb1c85101, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.478232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.492266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0bd0649a-f818-448d-ad56-733f57220d82 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:20.493527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0bd0649a-f818-448d-ad56-733f57220d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.501880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 803/1612] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:20.503509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.503509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.503715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.524603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:20.525928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.533921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 804/1613] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:20.534700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.544706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f667378-c97d-49e4-97fe-1ad56122fd17 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.553881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.553881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.553881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.553881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.554288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.554288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.580373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 810/1614] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:20 2022] PUT /identity/v3/projects/ca11299035ae4372a617680c28b177c2/users/536665d6dadd4b7d9e38080eb1c85101/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.582480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.622116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:20.633685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 805/1615] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:20 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:20.634810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.636939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:20.643351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc640969-9597-4296-9279-6ba7c83f39d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.695460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28717f-726b-48ef-8f15-eba7e89e0d4c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.699252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.699871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.700203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.700475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.700609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.703811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.704136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.704418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] PATH_INFO: `/v3/projects/cf8aa7b2ba054243be6169bbc742a162/users/d2cbd9bd731048578ecdf90d5ed5c5f5/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.709971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.711563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.724296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8aa7b2ba054243be6169bbc742a162, user_id=d2cbd9bd731048578ecdf90d5ed5c5f5, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.727177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.732772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 806/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:20.733882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.793809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79876781-f4e1-4c4d-8534-92329471a360 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.797884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.798943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.799226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.799496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.809961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:20.814990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 811/1617] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:20 2022] PUT /identity/v3/projects/cf8aa7b2ba054243be6169bbc742a162/users/d2cbd9bd731048578ecdf90d5ed5c5f5/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:20.816190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.866590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.868350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.878320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 807/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:20.879353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:20.893445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2978ef-315e-4f3b-bbb7-f1317c994e71 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.894749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43ffc1-0584-4554-a3d4-e35fa276a823 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:20.900917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.901255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:20.901370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.901460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:20.901553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.901653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:20.901746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.901832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:20.984238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.985641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:20.987098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57f251-7036-4a6c-9c34-13547518879d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:20.988746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.000954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 808/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:21.003158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.003654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.004296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.018722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 812/1620] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:21.020077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.040841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fd56b-9555-4c88-9732-9826462c52af service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.050193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.050830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.051159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.052372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] MFA Rules not processed for user `536665d6dadd4b7d9e38080eb1c85101`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:21.052507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.053188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.053623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:21.055763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.135550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:21.142822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 813/1621] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:21 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:21.144053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.167888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c82b0-366c-482c-a6ce-1cd031c10c4e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.178287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 809/1622] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:21.179854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.183108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.183749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.184060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.184336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.185133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.186753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd0ed8-54fd-4a3d-b68d-c1fd34bae0a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.217415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42ad88-aaa8-43a6-8a66-20774142d724 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.221255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 814/1623] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:21.222668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe9e1-12a2-467a-a0f6-3b2c2d4020ae None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.222965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe9e1-12a2-467a-a0f6-3b2c2d4020ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.223244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fe9e1-12a2-467a-a0f6-3b2c2d4020ae None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.228492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 815/1624] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 14:00:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:21.229325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe9e1-12a2-467a-a0f6-3b2c2d4020ae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.232698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.235718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.235718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.235718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.235983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.240627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14d453-eced-4cf3-a3ad-d2095cf3acce admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.261863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 810/1625] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:21.263341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bf1e-3b30-4139-a615-83b932812275 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.263636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bf1e-3b30-4139-a615-83b932812275 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.263951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984bf1e-3b30-4139-a615-83b932812275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.266097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fe9e1-12a2-467a-a0f6-3b2c2d4020ae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.271220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.276279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.276279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.276279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] PATH_INFO: `/v3/projects/cf8aa7b2ba054243be6169bbc742a162/users/d2cbd9bd731048578ecdf90d5ed5c5f5/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.282142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf8aa7b2ba054243be6169bbc742a162, user_id=d2cbd9bd731048578ecdf90d5ed5c5f5, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.285210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.309799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 816/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:21 2022] PUT /identity/v3/projects/cf8aa7b2ba054243be6169bbc742a162/users/d2cbd9bd731048578ecdf90d5ed5c5f5/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:21.316003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.341363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8984bf1e-3b30-4139-a615-83b932812275 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:21.342680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8984bf1e-3b30-4139-a615-83b932812275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:21.351641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:21.442941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd3fb-baf6-47d7-9ba1-819562366a2e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.450104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.451038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.451535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.451906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] PATH_INFO: `/v3/projects/1e62f4a237a64c14bcde61ca6f26301c/users/d80c1c6a1a534da5a74c4bbdeed9469c/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.476447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 811/1627] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:21.477948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.478294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.479734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e62f4a237a64c14bcde61ca6f26301c, user_id=d80c1c6a1a534da5a74c4bbdeed9469c, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.480318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.482841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.527176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] MFA Rules not processed for user `d2cbd9bd731048578ecdf90d5ed5c5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:21.528924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:21.606736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 812/1628] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:21.608185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.620691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9dff6-b15d-400c-81e3-b9d1603a7d48 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.626416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.626753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.627029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.627299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.675017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 817/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:21 2022] PUT /identity/v3/projects/1e62f4a237a64c14bcde61ca6f26301c/users/d80c1c6a1a534da5a74c4bbdeed9469c/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:21.678641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.755139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.756788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.773091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 813/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:21.773972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.797454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcc146-2eff-4a92-806a-a9abed6e4f95 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.797682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ede27-d0a0-4ff1-8360-1844b96eaba4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.824817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.824817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.824817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.824817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.906373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.907707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.908239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.908718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.909950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.912330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.923261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:21.927730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842e8ae-c780-4e7a-bc89-cbd3c3d38ac4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:21.927874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 814/1631] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:21.931280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:21.947195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6936-b29e-408c-b149-438caab1a4d0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:21.957141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 818/1632] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:21 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:21.982465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:21.985130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:21.986441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:21.986748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] PATH_INFO: `/v3/projects/1e62f4a237a64c14bcde61ca6f26301c/users/d80c1c6a1a534da5a74c4bbdeed9469c/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:21.992074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e62f4a237a64c14bcde61ca6f26301c, user_id=d80c1c6a1a534da5a74c4bbdeed9469c, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:22.004533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:22.032792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 815/1633] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:21 2022] PUT /identity/v3/projects/1e62f4a237a64c14bcde61ca6f26301c/users/d80c1c6a1a534da5a74c4bbdeed9469c/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:22.042832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.043404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.043937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.104089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:22.134696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] MFA Rules not processed for user `d80c1c6a1a534da5a74c4bbdeed9469c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:22.136486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:22.180652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:22.220277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:22.306246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 819/1634] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:22.315267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:22.360094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fdba45-a101-43ec-8949-83076a45067b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:22.366045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:22.367497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.367497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.367813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] PATH_INFO: `/v3/users/546deeefe5724d1281d4119652e4e301` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.370177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546deeefe5724d1281d4119652e4e301)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:22.374125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:22.397911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdec551-11a0-4c5e-a1b5-3bf42221c222 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:22.403064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:22.404920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.405500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.405795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.416483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:22.418121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d2a4-ae81-4ce7-8eac-137579eeefda service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:22.434292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 820/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:22.441111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b883bb7-a725-4cc2-b2bb-5586efe72236 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.441474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b883bb7-a725-4cc2-b2bb-5586efe72236 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.441760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b883bb7-a725-4cc2-b2bb-5586efe72236 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.443463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 821/1636] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 14:00:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:22.449197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.449482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.449756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.506452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:22.506452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:22.829479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546deeefe5724d1281d4119652e4e301'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:22.831522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 822/1637] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:00:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:22.831522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:22.831522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a063-f64a-4a8b-888a-8ea71b50df95 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:22.831522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba856d1b-ffc8-45b3-ad82-b132cc67ac45 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:22.833872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 823/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:22.837544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546deeefe5724d1281d4119652e4e301'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:22.837544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546deeefe5724d1281d4119652e4e301'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:22.837544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546deeefe5724d1281d4119652e4e301'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:22.837544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546deeefe5724d1281d4119652e4e301'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:22.880422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:22.881313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:22.882420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:22.888870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 816/1639] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:22 2022] DELETE /identity/v3/users/546deeefe5724d1281d4119652e4e301 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:22.940309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:22.946144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:23.075179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 824/1640] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:23.085858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:23.087650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:23.148151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:23.192476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade0000-92bb-44da-b5b5-7e44bbc5cb18 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:23.196724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:23.198065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:23.198451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:23.198834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:23.209441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:23.212071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:23.230891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 817/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:23.731578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:23.852476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:23.855025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:23.882138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fd71b9-862d-49a1-8a2f-5cb9dc3fdb1e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:23.888959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:23.890252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:23.890952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:23.891370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] PATH_INFO: `/v3/projects/841e0559b3a748e4b65fe46090402d2c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:23.893434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] RBAC: Authorizing `identity:delete_project(project_id=841e0559b3a748e4b65fe46090402d2c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:23.895854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:23.910345 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:23.912315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:23.941509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88edc28-a821-4003-ac0b-632978ea93b3 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:23.954617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:23.956193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:23.956650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:23.957087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] PATH_INFO: `/v3/users/1703c74bd9fc41b7a9f89a6380c5902b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:23.958616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1703c74bd9fc41b7a9f89a6380c5902b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:23.967592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:24.105608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841e0559b3a748e4b65fe46090402d2c', 'request_id': 'req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.115316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841e0559b3a748e4b65fe46090402d2c', 'request_id': 'req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.211391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1703c74bd9fc41b7a9f89a6380c5902b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.246110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841e0559b3a748e4b65fe46090402d2c', 'request_id': 'req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.278141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] The token cache is being invalidate because project 841e0559b3a748e4b65fe46090402d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:24.294792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.312460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0e21f71f-3a5b-4b9c-9fd3-b3df294d455f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.329024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 825/1642] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:23 2022] DELETE /identity/v3/projects/841e0559b3a748e4b65fe46090402d2c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:24.329478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1703c74bd9fc41b7a9f89a6380c5902b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.330226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1703c74bd9fc41b7a9f89a6380c5902b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.330924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1703c74bd9fc41b7a9f89a6380c5902b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.336428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.336729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.341139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.342404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-184aa0db-406a-4289-9a96-36d562f87e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1703c74bd9fc41b7a9f89a6380c5902b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:24.345210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 826/1643] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 14:00:24 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:24.351245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:24.359086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.384466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 818/1644] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:23 2022] DELETE /identity/v3/users/1703c74bd9fc41b7a9f89a6380c5902b => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:00:24.386495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17fdc-8f54-4204-b48b-6077c42de469 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.386888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17fdc-8f54-4204-b48b-6077c42de469 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.387774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17fdc-8f54-4204-b48b-6077c42de469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.413472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-17d17fdc-8f54-4204-b48b-6077c42de469 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:24.414918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-17d17fdc-8f54-4204-b48b-6077c42de469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.515422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d67cde-9d5d-4b49-9d8e-89ece554350d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:24.531110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 819/1645] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:24.532589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca473-fd3d-45f1-86da-a84903c7b22e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.532881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca473-fd3d-45f1-86da-a84903c7b22e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.533161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ca473-fd3d-45f1-86da-a84903c7b22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.595590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-856ca473-fd3d-45f1-86da-a84903c7b22e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:24.597143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-856ca473-fd3d-45f1-86da-a84903c7b22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.620766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:24.655180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:24.656151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.657520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.658020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] PATH_INFO: `/v3/users/d2cbd9bd731048578ecdf90d5ed5c5f5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.659619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cbd9bd731048578ecdf90d5ed5c5f5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:24.661351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: WARNING py.warnings [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:24.661351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: warnings.warn(msg) Sep 23 14:00:24.661351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: Sep 23 14:00:24.663961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:24.722081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 820/1646] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:24.723451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3f0f-1e79-4a38-9bb8-febdb004ad07 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.723745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3f0f-1e79-4a38-9bb8-febdb004ad07 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.727277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd3f0f-1e79-4a38-9bb8-febdb004ad07 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.729632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 821/1647] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 14:00:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:24.736331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.736435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.736725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.774329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:24.775987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.789076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 822/1648] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:00:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:24.790453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:24.791588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.894186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170d20c-f427-488a-bff6-88a0fec1c967 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:24.906107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:24.906789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:24.910358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:24.910358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:24.934105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:24.935731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:24.960752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 823/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:24.964945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:24.966711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:24.970458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cbd9bd731048578ecdf90d5ed5c5f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:25.076562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a54d5e-fbcc-4fbc-9587-49d6a2af67b8 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:25.083427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cbd9bd731048578ecdf90d5ed5c5f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:25.083822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:25.084229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cbd9bd731048578ecdf90d5ed5c5f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:25.084956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cbd9bd731048578ecdf90d5ed5c5f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:25.093093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:25.095033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:25.095346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:25.101132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:25.107378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cbd9bd731048578ecdf90d5ed5c5f5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:25.127721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:25.129159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:25.157675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 824/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:25.164588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 827/1651] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:24 2022] DELETE /identity/v3/users/d2cbd9bd731048578ecdf90d5ed5c5f5 => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:26.136894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:26.142529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:26.153949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f7c95b-f98c-45bd-92f5-9323f00e00af service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:26.267814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:26.268615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:26.269585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:26.269947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] PATH_INFO: `/v3/projects/4b78056f50354b469c6d5a3a981682d4` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:26.271367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b78056f50354b469c6d5a3a981682d4)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:26.272843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: WARNING py.warnings [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 23 14:00:26.272843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: warnings.warn(msg) Sep 23 14:00:26.272843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: Sep 23 14:00:26.274085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:26.358485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:26.479882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b78056f50354b469c6d5a3a981682d4', 'request_id': 'req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.305919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b78056f50354b469c6d5a3a981682d4', 'request_id': 'req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.313620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b78056f50354b469c6d5a3a981682d4', 'request_id': 'req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.350073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] The token cache is being invalidate because project 4b78056f50354b469c6d5a3a981682d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:27.350424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.352725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.357196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 825/1652] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:26 2022] DELETE /identity/v3/projects/4b78056f50354b469c6d5a3a981682d4 => generated 0 bytes in 1220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:27.360579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:27.378524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87da0e9-82c7-4d24-83ed-82e56736d3b2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:27.391660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:27.393233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:27.534779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:27.535600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:27.536035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:27.539228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] PATH_INFO: `/v3/users/d80c1c6a1a534da5a74c4bbdeed9469c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:27.540254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80c1c6a1a534da5a74c4bbdeed9469c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:27.548247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:27.631229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4f360-e84e-4bde-8386-6cc3f65d8fdf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:27.644626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:27.645301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:27.645581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:27.645853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] PATH_INFO: `/v3/projects/cf8aa7b2ba054243be6169bbc742a162` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:27.647116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf8aa7b2ba054243be6169bbc742a162)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:27.649807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:27.923725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80c1c6a1a534da5a74c4bbdeed9469c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:27.932458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf8aa7b2ba054243be6169bbc742a162', 'request_id': 'req-020086dc-6c67-4ee9-803b-92389be8eaba'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.010241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80c1c6a1a534da5a74c4bbdeed9469c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.010241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80c1c6a1a534da5a74c4bbdeed9469c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.010241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80c1c6a1a534da5a74c4bbdeed9469c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.064345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80c1c6a1a534da5a74c4bbdeed9469c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.073180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf8aa7b2ba054243be6169bbc742a162', 'request_id': 'req-020086dc-6c67-4ee9-803b-92389be8eaba'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.081156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf8aa7b2ba054243be6169bbc742a162', 'request_id': 'req-020086dc-6c67-4ee9-803b-92389be8eaba'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.119258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] The token cache is being invalidate because project cf8aa7b2ba054243be6169bbc742a162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:28.119735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.120552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-020086dc-6c67-4ee9-803b-92389be8eaba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.122606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 826/1653] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:27 2022] DELETE /identity/v3/projects/cf8aa7b2ba054243be6169bbc742a162 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:28.127194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918ecf-bebd-4b7b-bb04-905f41f9e6ee None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.127618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918ecf-bebd-4b7b-bb04-905f41f9e6ee None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.128025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0918ecf-bebd-4b7b-bb04-905f41f9e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.156248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 828/1654] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:27 2022] DELETE /identity/v3/users/d80c1c6a1a534da5a74c4bbdeed9469c => generated 0 bytes in 796 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:28.172263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b0918ecf-bebd-4b7b-bb04-905f41f9e6ee None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:28.175320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b0918ecf-bebd-4b7b-bb04-905f41f9e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:28.235001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:28.241821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:28.324596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 827/1655] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:28.333347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.338506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.338506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.376119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:28.377765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:28.386295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:28.391176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed094c3-82bb-4f3e-be3d-1e574fbee757 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:28.398222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 828/1656] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:28.402553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:28.406967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:28.407184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.407184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.407184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] PATH_INFO: `/v3/users/536665d6dadd4b7d9e38080eb1c85101` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.407184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536665d6dadd4b7d9e38080eb1c85101)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:28.412085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:28.421535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2c035-c40d-4047-abd6-080cdba3477a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:28.432775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:28.434887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.434887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.434887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.435236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:28.435795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:28.441548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:28.460640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 829/1657] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:28.465520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:28.482902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1556126e-c56e-4e13-a8db-22ad0e2c7ca0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:28.489198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:28.490115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.490506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.490877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.491625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:28.493788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:28.603897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 830/1658] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:28 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:28.605055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:28.644327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536665d6dadd4b7d9e38080eb1c85101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.723029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536665d6dadd4b7d9e38080eb1c85101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.723689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536665d6dadd4b7d9e38080eb1c85101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.724342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536665d6dadd4b7d9e38080eb1c85101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.728328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01132bd-54a6-45da-84a6-aea13e3686d1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:28.734614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f5e1a286-655b-4049-b548-1479f88d3fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536665d6dadd4b7d9e38080eb1c85101'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:28.740578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:28.741730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.742102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.743014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.743675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:28.748686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:28.777564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 829/1659] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:28 2022] DELETE /identity/v3/users/536665d6dadd4b7d9e38080eb1c85101 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:28.779579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:28.779956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:28.780249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:28.818037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:28.825373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:28.871240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 831/1660] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:28 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:28.872225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:28.874527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:28.904867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82585f-ffd1-4b20-98d3-9109c4515149 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:28.968513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 830/1661] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:29.016276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.017176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.021309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.021705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.022615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.024360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.049662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:29.052522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 832/1662] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:29.066236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fad92a-3565-49a9-8b21-5888099667f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:29.073977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.075186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.075186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.075364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.076133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.079556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.116290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 831/1663] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:29.120956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:29.137899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf33ffe-60cd-4a9c-be97-275e09831d27 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:29.147588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.149124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.150365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.150802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] PATH_INFO: `/v3/projects/88a1949000094085b8c8cb02481a5129/users/f14e81626214464a91aaac0ab5bc28ed/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.165324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:29.168272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:29.171573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:29.203222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a1949000094085b8c8cb02481a5129, user_id=f14e81626214464a91aaac0ab5bc28ed, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.227970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39522982-5c7e-45f6-b62a-e35e01a8ce3d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.319070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 833/1664] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:29 2022] PUT /identity/v3/projects/88a1949000094085b8c8cb02481a5129/users/f14e81626214464a91aaac0ab5bc28ed/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:29.321514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.321852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.322200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.347581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fb830-313d-4a45-bd4a-9bd673909220 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:29.430512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] MFA Rules not processed for user `f14e81626214464a91aaac0ab5bc28ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:29.433775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:29.516557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.517255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.517521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.517837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.654997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 834/1665] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:29.661290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:29.720188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.729935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.740824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:29.761102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 832/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:29.761997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:29.768982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:29.807818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4d3cc-a6bb-4bd9-bd38-79582f693492 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:29.813903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9dcdf-ee56-48ae-9559-b68a6742c677 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:29.821939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.823217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.823499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.823775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] PATH_INFO: `/v3/projects/1e62f4a237a64c14bcde61ca6f26301c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.825742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e62f4a237a64c14bcde61ca6f26301c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.827704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.828420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:29.829164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:29.839150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:29.841356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:29.845532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:29.857249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:29.992464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 835/1667] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:29 2022] POST /identity/v3/projects => generated 381 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:29.994911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:29.996748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.047205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e62f4a237a64c14bcde61ca6f26301c', 'request_id': 'req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:30.066405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e62f4a237a64c14bcde61ca6f26301c', 'request_id': 'req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:30.133866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f850460-e7d4-4e6c-83f6-e1e379a9f376 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.157335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e62f4a237a64c14bcde61ca6f26301c', 'request_id': 'req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:30.176545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] The token cache is being invalidate because project 1e62f4a237a64c14bcde61ca6f26301c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:30.176833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:30.178996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4c4e4fe5-1dc1-4812-aa1c-d68f2e00a410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:30.186008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 833/1668] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:29 2022] DELETE /identity/v3/projects/1e62f4a237a64c14bcde61ca6f26301c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:30.189822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8979-8631-43b5-9ecb-cbe33b5344d9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.190312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8979-8631-43b5-9ecb-cbe33b5344d9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.191040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b8979-8631-43b5-9ecb-cbe33b5344d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.260824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a45b8979-8631-43b5-9ecb-cbe33b5344d9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:30.266702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a45b8979-8631-43b5-9ecb-cbe33b5344d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:30.295037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.295980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.298800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.299942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.303304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.306783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.420451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 834/1669] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:30.429722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.430012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.430289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.438522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 836/1670] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:29 2022] POST /identity/v3/users => generated 297 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:30.440826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.443832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:30.465511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:30.468572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:30.480106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9acfe-32bf-48c8-a6fa-b98b912f2667 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.496968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 835/1671] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:30.500864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.501855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.502211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.502555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.502671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.503336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.509301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.516565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3ff31-8b6f-406b-bb4c-87da95e857f2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.532687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.533292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 837/1672] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:30.533382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.533595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.533869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.533984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.534629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:30.534816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.536633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.557856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206ee2d-fc4e-4c34-8573-b85144a7803f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.558877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 836/1673] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:30.563340 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.581216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.583669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.583903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.584067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d9e60-8755-4fa5-8576-4bef413fa0b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.584203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] PATH_INFO: `/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c/users/ace05ba725514dd6907b70e4774cab58/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.596039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.600285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.600285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.600285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.600285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.600285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.625659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af3b47d5ee147f1a76a64de5bcaf43c, user_id=ace05ba725514dd6907b70e4774cab58, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.627177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.728155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 838/1674] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:30 2022] PUT /identity/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c/users/ace05ba725514dd6907b70e4774cab58/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:30.729088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.755947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 837/1675] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:30 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:00:30.765698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:30.930221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f9045-f206-44b1-baa9-16b595773a22 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.942130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97ca7-88e0-4ce0-b241-b4a8edceb7cc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:30.945992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.946807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.948585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.949748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.951070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.964800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:30.965565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:30.966472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:30.969127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:30.969631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:30.970439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:30.976349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:31.014988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 839/1676] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:31.016205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.036473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b02150-40bb-496f-93b5-1bf8563cfa5d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.045350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.046042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.046326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.046603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] PATH_INFO: `/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c/users/ace05ba725514dd6907b70e4774cab58/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.083696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 838/1677] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:30 2022] POST /identity/v3/users => generated 288 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:31.087809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.092563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af3b47d5ee147f1a76a64de5bcaf43c, user_id=ace05ba725514dd6907b70e4774cab58, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:31.105980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cdaa8-8072-4b53-9fe1-74e9408ace30 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:31.122561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77f60-2ac9-40f2-8483-7ff9c96cd3c4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.137861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 840/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:31 2022] PUT /identity/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c/users/ace05ba725514dd6907b70e4774cab58/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:31.147943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.151985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.151985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.211047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] MFA Rules not processed for user `ace05ba725514dd6907b70e4774cab58`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:31.212580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:31.259788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.260673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.261107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.261522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.262309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:31.265048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:31.285062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 839/1679] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:00:31.288426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.293570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:31.311327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9dc1-f8c4-4df2-806c-52899180b976 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.330723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.331574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.332020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.332445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] PATH_INFO: `/v3/projects/ca11299035ae4372a617680c28b177c2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.334547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca11299035ae4372a617680c28b177c2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:31.336674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:31.419808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 841/1680] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:31.420935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.457069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23962cb2-8e06-4534-920a-beeee61efafc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.486302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.486967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.487251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.487585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.489148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:31.490891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:31.494822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:31.502032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca11299035ae4372a617680c28b177c2', 'request_id': 'req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:31.518162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 842/1681] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:31.518891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.524501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:31.528680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca11299035ae4372a617680c28b177c2', 'request_id': 'req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:31.574341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:31.622551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca11299035ae4372a617680c28b177c2', 'request_id': 'req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:31.668242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] The token cache is being invalidate because project ca11299035ae4372a617680c28b177c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:31.670532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:31.671693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:31.674794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 840/1682] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:31 2022] DELETE /identity/v3/projects/ca11299035ae4372a617680c28b177c2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:31.678321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:31.688480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:31.699402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b65d8d-5e24-4e08-a69b-86b83645f4c8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.812234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.812902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.813232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.814109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.817706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:31.868600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f6ca1-8fcc-41f8-bb8e-2d1ea15a7a7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:31.880631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:31.881330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:31.881609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:31.884335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] PATH_INFO: `/v3/projects/0f939fce9ae944018a383c1cc1144083/users/5d7e1cc4fc9e46daaec073d3966a6f0c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:31.943313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f939fce9ae944018a383c1cc1144083, user_id=5d7e1cc4fc9e46daaec073d3966a6f0c, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:31.953039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e92ae-9dfb-4373-89ab-291c8e2d3bd6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:32.048590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:32.050332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4554fc25-6665-40d6-9d0e-36bc7d149381 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:32.066712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 841/1683] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:31 2022] PUT /identity/v3/projects/0f939fce9ae944018a383c1cc1144083/users/5d7e1cc4fc9e46daaec073d3966a6f0c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:32.068237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fd98-6ecf-4fc2-bba3-f6b744632678 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.070575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fd98-6ecf-4fc2-bba3-f6b744632678 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.070575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55fd98-6ecf-4fc2-bba3-f6b744632678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.103147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 843/1684] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:32.106031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6048ef-d233-49cf-8ad0-3dadd994f5f4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.106318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6048ef-d233-49cf-8ad0-3dadd994f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.106591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6048ef-d233-49cf-8ad0-3dadd994f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.140321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5f55fd98-6ecf-4fc2-bba3-f6b744632678 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:32.148994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5f55fd98-6ecf-4fc2-bba3-f6b744632678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.203566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1d6048ef-d233-49cf-8ad0-3dadd994f5f4 None None] MFA Rules not processed for user `5d7e1cc4fc9e46daaec073d3966a6f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:32.204894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1d6048ef-d233-49cf-8ad0-3dadd994f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.323701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 842/1685] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:32.327586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.328088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.328841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.402136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] MFA Rules not processed for user `7b6d41c5989443b0954a147afd3b0417`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:32.403574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.404041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 844/1686] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:32.414264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.418027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.418027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.422346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:32.475026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:32.477729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.502606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 845/1687] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:32.505628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:32.526627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d33231-a598-4b0a-acd9-0f6b7c1b324f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:32.539197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:32.539822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.543011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.543315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.544758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:32.548288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:32.585122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 843/1688] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:32.591117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:32.591117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.610760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:32.688638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 846/1689] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:32.690104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:32.731005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93457-75c9-4735-8a36-cd8b229aad2e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:32.828312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bf867-87aa-4079-bb34-8cd0263d39ff admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:32.843657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:32.847695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.847695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.847695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.850083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:32.856244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:32.857064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.857481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.858017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.859030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:32.859469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:32.861351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d8aef-3445-44b2-993d-40646eb7ce09 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:32.878949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 847/1690] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:32.881071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:32.881356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:32.881633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:32.904571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] MFA Rules not processed for user `7b6d41c5989443b0954a147afd3b0417`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:32.911187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:33.004261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.006228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 848/1691] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:33.007077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.014279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.031807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab6f8-3a9c-40dc-89ab-82bf2c1ccd6d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.045614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.046247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.046529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.046804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.047446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.056650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 844/1692] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:33.057840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.060249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.097933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54238ba-b025-42b2-ae9e-60035f17b387 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.117614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.118464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.118902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.119434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.125555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.125555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.193468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 849/1693] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:33 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:33.194334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.198300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:33.235193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 845/1694] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:33 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:33.237454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.422931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77951154-e05a-4bb3-9d4e-4dc11785cd02 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.437532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80f802-2584-492b-8a8d-476473357164 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.449345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.449995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.452480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.452787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.453461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.457265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.492605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 846/1695] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:33.493734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.534831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee543a-5f3a-4c65-9480-912518a25737 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.548784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.548784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.548784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.549806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.553645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.562545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.571301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:33.621784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.622434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.622762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.623036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.722249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 847/1696] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:33 2022] POST /identity/v3/users => generated 288 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:33.722249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.742024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bea35a-cc03-4f31-8962-0334aa10384e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.747912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.749977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.753423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.754119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.754402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.754678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] PATH_INFO: `/v3/projects/0dc2131cd93941058e8b577a44322292/users/319729c0add6450abdd5c1011110ac9b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.772264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 850/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:33.773437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.789816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc2131cd93941058e8b577a44322292, user_id=319729c0add6450abdd5c1011110ac9b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.797661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.798933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740fab0-0d57-4a9e-8bb2-3e4f7b0de9f8 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.805747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.807000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.807368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.807690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.808951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.811416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.827544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:33.829408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.842624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3aff7d-dfd4-4a98-b499-64d275095bcd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.848265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.849121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.849600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.849998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.850754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.853140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:33.865905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 852/1699] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:33.871975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.893897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486e520-e437-4677-b0e2-f2e6573bb8b4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:33.914543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 848/1700] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:33 2022] PUT /identity/v3/projects/0dc2131cd93941058e8b577a44322292/users/319729c0add6450abdd5c1011110ac9b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:33.915698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:33.918323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:33.919507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:33.919507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] PATH_INFO: `/v3/projects/f3b2a3096c154aa1ba1e09776a1b63e5/users/b0e3bb0c39704910a82f4183cf6fb06a/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:33.920740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:33.959651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b2a3096c154aa1ba1e09776a1b63e5, user_id=b0e3bb0c39704910a82f4183cf6fb06a, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:33.962380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae7372-3f9a-4bd6-9f62-9c3b0085ff5d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:34.088075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 853/1701] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:33 2022] PUT /identity/v3/projects/f3b2a3096c154aa1ba1e09776a1b63e5/users/b0e3bb0c39704910a82f4183cf6fb06a/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:34.088752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2bac1-97d6-4c22-9f1c-b2201bc4076f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:34.089731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.090175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.090668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:34.168124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] MFA Rules not processed for user `b0e3bb0c39704910a82f4183cf6fb06a`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:34.169697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:34.218639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:34.219465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.219826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.220373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:34.221114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:34.229145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:34.232884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:34.261184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 849/1702] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:34.263042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:34.292960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b68c29-db7b-46f3-8f5d-1b92a819a480 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:34.306948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:34.307712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.308072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.308575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] PATH_INFO: `/v3/projects/0dc2131cd93941058e8b577a44322292/users/319729c0add6450abdd5c1011110ac9b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:34.324686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc2131cd93941058e8b577a44322292, user_id=319729c0add6450abdd5c1011110ac9b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:34.334929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 854/1703] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:34.336886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2abcd-11c9-4ab6-a507-858d153dcbe6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:34.342794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:34.345183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:34.370861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 850/1704] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:34 2022] PUT /identity/v3/projects/0dc2131cd93941058e8b577a44322292/users/319729c0add6450abdd5c1011110ac9b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:34.383206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.384418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.386313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:34.498241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] MFA Rules not processed for user `319729c0add6450abdd5c1011110ac9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:34.500322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:34.556684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487429a0-c965-4534-aa80-7b06f3e74b2c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:34.646620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 851/1705] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:34.658727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:34.664966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:34.682856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.682856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.682856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:34.719188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:34.762971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:34.764934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3602283-c329-4372-8ee1-58853c2adb00 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:34.783217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 855/1706] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:34.886841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b0d5c-d5e4-4dba-ab38-16b9ba1de5c6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:34.901131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:34.901774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:34.902107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:34.902383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:35.121003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:35.122485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b95ce-f087-4da3-b062-e105556acdfa service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:35.156232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 852/1707] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:35.175062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:35.657575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:35.661865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:35.662457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:35.672265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 856/1708] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 14:00:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:35.673794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:35.673987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:35.674262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:35.774055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:35.776656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:35.888585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 853/1709] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:00:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:35.935653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:35.958826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:35.961710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:36.010735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824799f-4e92-4107-b4ec-897d7e635d4e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:36.031563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:36.033582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:36.036981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:36.036981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:36.061879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:36.065403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41f76f-e65b-4fbb-aafe-fb9157c5f7a3 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:36.138376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 857/1710] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:36.523283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:36.567141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:36.587133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:36.686172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428d17-795e-4b81-add5-611ba4692a9e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:36.696578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:36.698647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:36.699083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:36.699528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] PATH_INFO: `/v3/users/b0e3bb0c39704910a82f4183cf6fb06a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:36.700959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e3bb0c39704910a82f4183cf6fb06a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:36.704865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:36.760195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:36.764540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:36.766765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:36.817966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] MFA Rules not processed for user `bc7fd21870f94086a6a0325650a49d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:36.829989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:36.995333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e3bb0c39704910a82f4183cf6fb06a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:37.007561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 858/1711] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:37.023385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:37.046483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d529c-43da-437a-a331-9ba1fcc252eb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:37.056009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:37.057545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:37.057951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:37.058294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:37.067699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:37.069498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a85d95-3fd6-4c60-a6ae-2ccaa31e30b3 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:37.071544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e3bb0c39704910a82f4183cf6fb06a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:37.072644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e3bb0c39704910a82f4183cf6fb06a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:37.073625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e3bb0c39704910a82f4183cf6fb06a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:37.082248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 859/1712] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:37.086119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e3bb0c39704910a82f4183cf6fb06a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:37.122286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 854/1713] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:36 2022] DELETE /identity/v3/users/b0e3bb0c39704910a82f4183cf6fb06a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:37.123215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e2080-e072-49b2-8898-8bf17b94f4c5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:37.123840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e2080-e072-49b2-8898-8bf17b94f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:37.124372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e2080-e072-49b2-8898-8bf17b94f4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:37.154813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a70e2080-e072-49b2-8898-8bf17b94f4c5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:37.155833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a70e2080-e072-49b2-8898-8bf17b94f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:37.264828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 860/1714] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:37.271609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:37.273627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:37.379342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc2707-a184-482d-aa85-442c32414e24 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:37.388459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:37.389555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:37.389840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:37.390115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:37.422420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:37.432474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:37.437591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:37.441252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:37.441735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:37.472739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 855/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:37.550565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] MFA Rules not processed for user `57e6a1e99a7c4dfd922299028a4ea809`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:37.559979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:37.769904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:37.771547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:37.858462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 861/1716] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:37.874192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:37.875902 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:37.949452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcedb3-a977-4aeb-9f21-6f1af74b0e18 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:37.966121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:37.967027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:37.967534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:37.967962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:37.970457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:38.020768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:38.027626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:38.058007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 856/1717] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:38.136232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2b2f0-bb2c-4548-a0ed-2a67517316b4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:38.147142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:38.147791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:38.148102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:38.148378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:38.174890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:38.176597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc1453-e159-4931-8540-2d854ea6a9bb service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:38.212708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 862/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:38.277927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:38.371066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:38.437140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:38.438174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:38.461902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88be2e-2f71-4a28-bce8-ff47bf0c6b95 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:38.479450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:38.480350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:38.480774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:38.481272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] PATH_INFO: `/v3/users/f6ded13ce6624dc4b23f156c03e55f8e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:38.488874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ded13ce6624dc4b23f156c03e55f8e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:38.505039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:38.865299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ded13ce6624dc4b23f156c03e55f8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:38.984717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ded13ce6624dc4b23f156c03e55f8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:38.985410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ded13ce6624dc4b23f156c03e55f8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:38.986082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ded13ce6624dc4b23f156c03e55f8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:38.994418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ded13ce6624dc4b23f156c03e55f8e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.019629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 857/1719] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:38 2022] DELETE /identity/v3/users/f6ded13ce6624dc4b23f156c03e55f8e => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:39.020539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:39.021025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:39.021136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:39.045077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:39.060781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:39.062216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:39.148065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:39.149613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:39.210471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 863/1720] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:39.248897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:39.249602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:39.388373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c257950-0e06-4d5b-9211-463b092ae560 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:39.411555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:39.414445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:39.414747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:39.415420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] PATH_INFO: `/v3/projects/f3b2a3096c154aa1ba1e09776a1b63e5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:39.417835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b2a3096c154aa1ba1e09776a1b63e5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:39.422025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:39.473090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21d105-e354-4a74-9aae-7b91052e799e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:39.490056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:39.490946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:39.491370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:39.491786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:39.515377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:39.517532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:39.543114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 864/1721] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:39.608283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:39.615843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:39.661556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b2a3096c154aa1ba1e09776a1b63e5', 'request_id': 'req-adadae10-c7cc-42c8-b667-afa44d1eb4d2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.684792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b2a3096c154aa1ba1e09776a1b63e5', 'request_id': 'req-adadae10-c7cc-42c8-b667-afa44d1eb4d2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.780981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b2a3096c154aa1ba1e09776a1b63e5', 'request_id': 'req-adadae10-c7cc-42c8-b667-afa44d1eb4d2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.811624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] The token cache is being invalidate because project f3b2a3096c154aa1ba1e09776a1b63e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:39.811964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.814759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-adadae10-c7cc-42c8-b667-afa44d1eb4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:39.823574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 858/1722] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:39 2022] DELETE /identity/v3/projects/f3b2a3096c154aa1ba1e09776a1b63e5 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:00:39.828000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba109a4-ea9a-4395-9dbc-50fa4f589261 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:39.830111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e044c0-424b-42be-8c2f-9b4410b69e53 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:39.830400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e044c0-424b-42be-8c2f-9b4410b69e53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:39.830913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e044c0-424b-42be-8c2f-9b4410b69e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:39.950734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:39.961032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2e044c0-424b-42be-8c2f-9b4410b69e53 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:39.962363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2e044c0-424b-42be-8c2f-9b4410b69e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.107472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:40.108391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:40.111664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.126270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.129279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.134804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.162614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 859/1723] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:40.172737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.172737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.172737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.228858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:40.229218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.262602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 860/1724] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:40.268128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:40.285183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:40.288747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:40.294459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc865a1a-343e-4a3e-8093-0fcc32e77363 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:40.305723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:40.306467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.306932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.307118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 865/1725] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:40.307459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.308222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:40.308761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:40.310542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02b48-6a83-4108-8d26-b029d4d0cd01 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:40.344745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 861/1726] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:40.347428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:40.369302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63328931-bd30-4e07-91e3-84d7898a6833 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:40.388701 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:40.389339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.389619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.391072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.391907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:40.398299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:40.551170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.551678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.552219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.568892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 866/1727] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:40 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:40.574318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:40.674607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] MFA Rules not processed for user `47aa5cf320134658b77c2fc5e4debcde`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:40.674607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.675831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:40.743791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d3fee-1cc5-47d3-b947-8fffd740fabd admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:40.767962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:40.768915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.769378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.769833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.771005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:40.775800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:40.864092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 862/1728] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:40.864092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:40.864092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.906749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 867/1729] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:40 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:40.907821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:40.910275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:40.946075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2035e-3a83-49b1-addb-67926ee08fb0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:40.964856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:40.964856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:40.964856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:40.965133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] PATH_INFO: `/v3/projects/b854fc8776dd4f568ed0fdd6320014b3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:40.968808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b854fc8776dd4f568ed0fdd6320014b3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:40.974757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.090453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7206b-46b4-4531-b316-0e38556750b7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.098999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:41.111670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.113666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.113959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.127565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:41.131331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.148599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 868/1730] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:41.151871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:41.209352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f8a86-1409-4b74-b014-66cb7906b4c2 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.218896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b854fc8776dd4f568ed0fdd6320014b3', 'request_id': 'req-e2eb2a71-1349-4e58-adfb-e59b681d198d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:41.242210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b854fc8776dd4f568ed0fdd6320014b3', 'request_id': 'req-e2eb2a71-1349-4e58-adfb-e59b681d198d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:41.356026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b854fc8776dd4f568ed0fdd6320014b3', 'request_id': 'req-e2eb2a71-1349-4e58-adfb-e59b681d198d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:41.369326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:41.370074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.370461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.370861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.372328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:41.374896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.387561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 869/1731] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:41.396410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:41.408157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] The token cache is being invalidate because project b854fc8776dd4f568ed0fdd6320014b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:41.409038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:41.411676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e2eb2a71-1349-4e58-adfb-e59b681d198d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:41.416388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 863/1732] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:40 2022] DELETE /identity/v3/projects/b854fc8776dd4f568ed0fdd6320014b3 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:41.426933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c958-f23b-4023-8019-552751e24fb6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.427600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b3421-5c5e-41ca-9e45-3c146e640283 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.428038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c958-f23b-4023-8019-552751e24fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.428504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7c958-f23b-4023-8019-552751e24fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.444611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:41.447041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.450880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.450880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.450880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:41.451467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.470809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 870/1733] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:00:41.477436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:41.481094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:41.512940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977114f-7e0c-41c5-9814-35e6adef1448 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.520761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:41.521694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.522125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.522455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cea7c958-f23b-4023-8019-552751e24fb6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:41.522776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] PATH_INFO: `/v3/projects/a56daa3f57a340c3875951ba57a894c5/users/a08552437e554194b967b13dba313e11/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.526656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cea7c958-f23b-4023-8019-552751e24fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:41.578846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 864/1734] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:41.587051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.591681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.591681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.611836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a56daa3f57a340c3875951ba57a894c5, user_id=a08552437e554194b967b13dba313e11, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:41.630001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da4d78-3135-4af4-a0f0-18c6dcaddbd3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.655851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:41.660233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:41.692758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 865/1735] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:41.694984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:41.717825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9497ca0-aa2e-4360-9480-f0ff23a88c12 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.730561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:41.731222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.731503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.731779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.732491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:41.732800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:41.737654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:41.748565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 871/1736] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:41 2022] PUT /identity/v3/projects/a56daa3f57a340c3875951ba57a894c5/users/a08552437e554194b967b13dba313e11/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:00:41.759033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:41.759381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:41.759653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:41.784525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 866/1737] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:00:41.788846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:41.823072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cc26e-c14a-4152-82f0-40445125c8ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:41.848394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] MFA Rules not processed for user `a08552437e554194b967b13dba313e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:41.850587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:42.010729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.012488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.013572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.015991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.017276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.020364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.045708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 872/1738] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:42.047083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.078885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb594c0-10d2-4557-970b-9e4671468d7c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.094612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.095454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.095708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.096032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.096694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.103309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.230646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 867/1739] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:41 2022] POST /identity/v3/projects => generated 373 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:42.236266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.266522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 873/1740] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:42 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:42.268520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.361748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57e74a6-8382-487f-8dd6-83cd7ffaef14 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.441787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:42.452778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c6afa2-0a84-435d-a6a1-abf68acd37af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.486348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.486998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.487290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.487550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.488436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.491568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.492135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.492615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.495231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.496465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.497342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.498470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.505269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:42.742274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 868/1742] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:42 2022] POST /identity/v3/users => generated 287 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:42.746093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 874/1742] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:42 2022] POST /identity/v3/users => generated 296 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:42.747085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.748551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.778468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db860-8201-4cda-9537-6e533582750e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.783566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910b883-d936-4731-b48c-7901934fea8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.797245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.797892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.798178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.798459 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.799138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.800884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.804010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.804650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.804927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.805199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.805858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.808142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.833039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 875/1743] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:42.845931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.850870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 869/1744] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:42.852477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.878989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92af39-ce33-4cee-82ce-00d9c40b0f21 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.884450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a62d4-3bbf-4bda-a367-348f4a4489af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:42.898951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.900425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.901204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:42.903826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.904748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:42.905136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.905954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.906480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:42.906818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] PATH_INFO: `/v3/projects/c86f67b254754f13bf8550ac9024100c/users/af2efb881f4e425fb38302a94203fe8a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:42.909427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:42.954996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 876/1745] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:42.957675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:42.963934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86f67b254754f13bf8550ac9024100c, user_id=af2efb881f4e425fb38302a94203fe8a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:42.974639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74bcf7-270a-43b6-89c0-d8c5481a21b7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:43.008359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd03c9-d380-46bd-8e79-ff5f81c5748e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:43.013866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:43.014610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.014903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.015174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] PATH_INFO: `/v3/projects/c4e619e6f338401ca852cd613d637a77/users/622f2a032c19405895906f6f9df1ac0b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.066934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 870/1746] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:42 2022] PUT /identity/v3/projects/c86f67b254754f13bf8550ac9024100c/users/af2efb881f4e425fb38302a94203fe8a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:43.072510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3aa0f-97a7-40da-b29a-224882020dfe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.072996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3aa0f-97a7-40da-b29a-224882020dfe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.073457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3aa0f-97a7-40da-b29a-224882020dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.086126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e619e6f338401ca852cd613d637a77, user_id=622f2a032c19405895906f6f9df1ac0b, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:43.096111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:43.146617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2fb3aa0f-97a7-40da-b29a-224882020dfe None None] MFA Rules not processed for user `bc7fd21870f94086a6a0325650a49d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:43.151649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2fb3aa0f-97a7-40da-b29a-224882020dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:43.220193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 877/1747] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:42 2022] PUT /identity/v3/projects/c4e619e6f338401ca852cd613d637a77/users/622f2a032c19405895906f6f9df1ac0b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:43.234617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:43.327840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 871/1748] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:43.333243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eac04-6d26-4050-8789-6af932cb5b42 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.333243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eac04-6d26-4050-8789-6af932cb5b42 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.333243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486eac04-6d26-4050-8789-6af932cb5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.419408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50395836-95f2-47d8-bece-9552c445d58e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:43.430715 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-486eac04-6d26-4050-8789-6af932cb5b42 None None] MFA Rules not processed for user `622f2a032c19405895906f6f9df1ac0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:43.435361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-486eac04-6d26-4050-8789-6af932cb5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:43.442090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:43.443078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.444356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.445592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.451787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:43.465031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:43.505408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 878/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:43.510461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:43.564105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b173651d-c0f8-4e96-ad77-f94f9f093fe5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:43.586938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:43.586938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.586938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.586938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] PATH_INFO: `/v3/projects/c86f67b254754f13bf8550ac9024100c/users/af2efb881f4e425fb38302a94203fe8a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.599060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86f67b254754f13bf8550ac9024100c, user_id=af2efb881f4e425fb38302a94203fe8a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:43.608849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b0050b-c2d9-4a48-8ebf-a476b834d0ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:43.648138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 879/1750] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:43 2022] PUT /identity/v3/projects/c86f67b254754f13bf8550ac9024100c/users/af2efb881f4e425fb38302a94203fe8a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:43.651863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.655845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.655845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.807549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:43.809930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:43.827359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 872/1751] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:43.828728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:43.829017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:43.829294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:43.923198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] MFA Rules not processed for user `af2efb881f4e425fb38302a94203fe8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:43.928740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:43.999360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 880/1752] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:44.001445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:44.119508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 873/1753] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:44.131076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:44.132949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:44.165885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab6170-d599-44ed-9a7d-24f2d32cf9f8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:44.177435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:44.181014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.181014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.181014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.181014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:44.186658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75321b-5cf9-404b-9403-c2e99818c1e8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:44.254253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060d97b-43ab-485d-9cb3-17170c8167e4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:44.262817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:44.263494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.263778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.265670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.284281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:44.285808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:44.289614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:44.300485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 874/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:44.337825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 881/1755] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:43 2022] POST /identity/v3/projects => generated 373 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:44.342719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:44.370091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf0c33-ed07-4632-97d4-88eb033e54a8 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:44.470814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13efe0-81dc-45c5-ab71-8b7ff35f9b7d None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.471286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13efe0-81dc-45c5-ab71-8b7ff35f9b7d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.473078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13efe0-81dc-45c5-ab71-8b7ff35f9b7d None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.476619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 882/1756] 10.222.0.48 () {54 vars in 912 bytes} [Fri Sep 23 14:00:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:44.487612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.487933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.488218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.535719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:44.537024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:44.585662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:44.586118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.586335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.586586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.593281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:44.600976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fe161-d4fc-4aae-8f2d-51858386976b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:44.629651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 883/1757] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:44.631033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:44.633301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:44.731490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 875/1758] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:44 2022] POST /identity/v3/users => generated 293 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:44.733218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.733666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.734929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.776638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7eb10-be34-4660-8fde-a0356226d0a9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:44.785066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:44.785216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.785534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.786022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.856771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] MFA Rules not processed for user `57e6a1e99a7c4dfd922299028a4ea809`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:44.860306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:44.898318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:44.902375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:44.929098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 884/1759] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:00:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:00:44.933477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:44.960509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db36321c-0b3d-4969-8d19-5d2f7c1b2a6f service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:44.972098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:44.972740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:44.973041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:44.973475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:44.974478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:44.980082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:45.007570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 885/1760] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:45.012922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:45.027686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:45.028744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 876/1761] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:45.029708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:45.104664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf101e8d-2d35-49f9-9413-be58707c6728 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:45.114089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b18837-93a0-4209-a5ed-c9add001c614 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:45.123197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:45.123898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.128429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.134797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] PATH_INFO: `/v3/projects/4bb6bde855434776b38cd56c2bdfc243/users/7c81636f603042c9bbbc2443460d0563/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.135831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:45.149660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.151068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.153399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.175326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:45.204126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:45.226395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb6bde855434776b38cd56c2bdfc243, user_id=7c81636f603042c9bbbc2443460d0563, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:45.244513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae39931-c9a1-4420-b015-28005b014d79 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:45.244739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 886/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:45.373372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 877/1763] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:45 2022] PUT /identity/v3/projects/4bb6bde855434776b38cd56c2bdfc243/users/7c81636f603042c9bbbc2443460d0563/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:45.377427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:45.395303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e204e27-ca77-4945-9632-9a33deda3b90 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:45.533707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:45.534609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.534609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.534859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.535536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:45.538080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:45.568764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.569055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.569329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.591535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 887/1764] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:45.594289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:45.630751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:45.632033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:45.635713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e3d26-dd61-44fe-b0fa-ff008e709c12 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:45.683579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:45.691954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:45.692764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.693053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.693332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] PATH_INFO: `/v3/projects/4bb6bde855434776b38cd56c2bdfc243/users/7c81636f603042c9bbbc2443460d0563/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.707618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb6bde855434776b38cd56c2bdfc243, user_id=7c81636f603042c9bbbc2443460d0563, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:45.723549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac085411-fa32-40ad-b026-1c576e16e9a2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:45.792087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 888/1765] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:45 2022] PUT /identity/v3/projects/4bb6bde855434776b38cd56c2bdfc243/users/7c81636f603042c9bbbc2443460d0563/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:45.804829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:45.805118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:45.805405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:45.883392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 878/1766] 10.222.0.64 () {58 vars in 1015 bytes} [Fri Sep 23 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:45.912574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] MFA Rules not processed for user `7c81636f603042c9bbbc2443460d0563`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:45.914420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:45.939460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:45.950240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d043954a-70ea-41a8-a267-7e011c123c01 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:46.055727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:46.059295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:46.059789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:46.073923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:46.108421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:46.121864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:46.164442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 879/1767] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:46.166182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:46.223714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 889/1768] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:46.230707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:46.234127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:46.394060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd71967-22fb-462a-9d24-d2d49008cc63 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:46.418586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2efb881f4e425fb38302a94203fe8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c86f67b254754f13bf8550ac9024100c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:46.419554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:46.420091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:46.420547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:46.431809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:46.432524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:46.440020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:46.477452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913adea-6eef-439b-bc82-5e05eb1615a3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:46.491113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:46.495300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:46.496270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:46.499300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:46.532183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:46.535812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:46.537113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 880/1769] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:46.544561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:46.553053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:46.596323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 890/1770] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:46.604325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:46.648096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0e50e-fdfc-498a-b1fc-2fdbcdbf00f8 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:46.668736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2efb881f4e425fb38302a94203fe8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c86f67b254754f13bf8550ac9024100c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:46.669377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:46.669665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:46.669941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:46.670588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:46.682243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:47.028698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf0c9c-1617-4661-a855-8542d74bcaac tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:47.028698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:47.028698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:47.030469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:47.030469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] PATH_INFO: `/v3/users/f14e81626214464a91aaac0ab5bc28ed` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:47.030469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14e81626214464a91aaac0ab5bc28ed)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:47.030469 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:47.511998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 891/1771] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:46 2022] POST /identity/v3/projects => generated 354 bytes in 907 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:47.511998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:47.511998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:47.680457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14e81626214464a91aaac0ab5bc28ed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:47.741615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb82e4-cb8e-4930-bb51-d9bf5c8e875f tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:47.753597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:47.757136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:47.758179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:47.758756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:47.817072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14e81626214464a91aaac0ab5bc28ed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:47.819119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14e81626214464a91aaac0ab5bc28ed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:47.819870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14e81626214464a91aaac0ab5bc28ed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:47.851674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14e81626214464a91aaac0ab5bc28ed'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:47.892199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 881/1772] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:46 2022] DELETE /identity/v3/users/f14e81626214464a91aaac0ab5bc28ed => generated 0 bytes in 1355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:47.895434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:47.895434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:47.895623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:47.897058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d3eaa-cbd9-4804-abd7-490c6226f1f6 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:47.938615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 892/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:47.940387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:47.941973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:47.942337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:48.007806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:48.016800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:48.049801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44b3f8-24d4-4711-aa6e-ffce7e5fe603 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:48.069191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2efb881f4e425fb38302a94203fe8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c86f67b254754f13bf8550ac9024100c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:48.070897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:48.070897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:48.070897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:48.075513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:48.078886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:48.085549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:48.127271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 882/1774] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:48.217348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:48.233031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765049a-02c2-4e58-acbc-7e122bf6ae55 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:48.285213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af2efb881f4e425fb38302a94203fe8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c86f67b254754f13bf8550ac9024100c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:48.288958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:48.293477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:48.293857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] PATH_INFO: `/v3/projects/a2acc165905743e7aab0f7fc6df9378a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:48.300911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a2acc165905743e7aab0f7fc6df9378a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:48.313788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:48.388311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 893/1775] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:48.420160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:48.421867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:48.560214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:48.641738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90768bdd-4b5b-43ff-bef2-6242ff54f64f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:48.663631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2acc165905743e7aab0f7fc6df9378a', 'request_id': 'req-daca0d8b-0825-4b0e-b317-27d75492d458'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:48.685320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2acc165905743e7aab0f7fc6df9378a', 'request_id': 'req-daca0d8b-0825-4b0e-b317-27d75492d458'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:48.706314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:48.791318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2acc165905743e7aab0f7fc6df9378a', 'request_id': 'req-daca0d8b-0825-4b0e-b317-27d75492d458'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:48.802407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:48.804686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:48.805450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:48.806822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:48.811357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] The token cache is being invalidate because project a2acc165905743e7aab0f7fc6df9378a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:48.814002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:48.814002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-daca0d8b-0825-4b0e-b317-27d75492d458 tempest-VolumeQuotaClassesTest-748311111 tempest-VolumeQuotaClassesTest-748311111-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:48.815152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 883/1776] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:48 2022] DELETE /identity/v3/projects/a2acc165905743e7aab0f7fc6df9378a => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:48.816956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9cb6-83a0-4707-a87c-aedaae351bca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:48.817311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9cb6-83a0-4707-a87c-aedaae351bca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:48.817656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a9cb6-83a0-4707-a87c-aedaae351bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:48.875884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-676a9cb6-83a0-4707-a87c-aedaae351bca None None] MFA Rules not processed for user `47aa5cf320134658b77c2fc5e4debcde`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:48.893201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-676a9cb6-83a0-4707-a87c-aedaae351bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:49.059406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:49.061372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:49.078530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 894/1777] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:49.089866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:49.111221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 884/1778] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:49.669974 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:49.671855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:49.694782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6c854-d298-44f7-acf6-9c74e3e7a4f2 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:49.702847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:49.705269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:49.707546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:49.708499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] PATH_INFO: `/v3/users/a08552437e554194b967b13dba313e11` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:49.714659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08552437e554194b967b13dba313e11)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:49.721660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:49.999044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08552437e554194b967b13dba313e11'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:50.067456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08552437e554194b967b13dba313e11'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:50.068242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08552437e554194b967b13dba313e11'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:50.069137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08552437e554194b967b13dba313e11'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:50.081893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08552437e554194b967b13dba313e11'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:50.115769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 895/1779] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:49 2022] DELETE /identity/v3/users/a08552437e554194b967b13dba313e11 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:50.117879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2179-828b-489e-bb78-6138dd0a0741 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:50.119373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2179-828b-489e-bb78-6138dd0a0741 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:50.119829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c2179-828b-489e-bb78-6138dd0a0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:50.170127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca9c2179-828b-489e-bb78-6138dd0a0741 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:50.171383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca9c2179-828b-489e-bb78-6138dd0a0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:50.377916 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 885/1780] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:50.390901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:50.392417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:50.525164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876afce-6d84-46af-a123-5511aa732394 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:50.529497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:50.530725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:50.531203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:50.531613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:50.577131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:50.581408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6827c6e-f053-46c9-a4df-9af82166a017 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:50.629640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 896/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:50.787255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:50.866040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:50.866599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:50.866886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:50.870921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 886/1782] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:00:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:51.000178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:51.004428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:51.006782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:51.033516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:51.035693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:51.078905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:51.089901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:51.094074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:51.100236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240616bf-8289-4672-a80f-0ebb66ac1410 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:51.116705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:51.117687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:51.118181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:51.119190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] PATH_INFO: `/v3/projects/88a1949000094085b8c8cb02481a5129` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:51.129497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a1949000094085b8c8cb02481a5129)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:51.132835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:51.335076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a1949000094085b8c8cb02481a5129', 'request_id': 'req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.365406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a1949000094085b8c8cb02481a5129', 'request_id': 'req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.406958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 897/1783] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:51.471144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a1949000094085b8c8cb02481a5129', 'request_id': 'req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.490126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] The token cache is being invalidate because project 88a1949000094085b8c8cb02481a5129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:51.490615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.492327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.500487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 887/1784] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:51 2022] DELETE /identity/v3/projects/88a1949000094085b8c8cb02481a5129 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:51.512145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:51.533503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a085e4-5dda-48d3-b8ac-6feb5e2c5497 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:51.553777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:51.683738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:51.684576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:51.684947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:51.685152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] PATH_INFO: `/v3/users/ace05ba725514dd6907b70e4774cab58` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:51.688640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace05ba725514dd6907b70e4774cab58)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:51.690630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:51.905183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace05ba725514dd6907b70e4774cab58'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.969619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace05ba725514dd6907b70e4774cab58'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.969882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace05ba725514dd6907b70e4774cab58'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.971156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace05ba725514dd6907b70e4774cab58'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:51.990756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace05ba725514dd6907b70e4774cab58'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:52.081596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 898/1785] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:51 2022] DELETE /identity/v3/users/ace05ba725514dd6907b70e4774cab58 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:52.305816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:52.653963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:52.655674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:52.841662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b022a-1caf-4cc1-8ad6-3d1010aecaad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:52.932357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:52.934626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:52.950781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:52.951645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:52.952047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:52.952366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:52.954771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:52.972301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:52.979541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:52.999164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 888/1786] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:53.116241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f2d46-01c9-4b2a-a6d6-cb15abef6d72 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:53.136715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:53.138606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:53.138606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:53.138606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] PATH_INFO: `/v3/projects/a56daa3f57a340c3875951ba57a894c5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:53.145238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a56daa3f57a340c3875951ba57a894c5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:53.147781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:53.354397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a56daa3f57a340c3875951ba57a894c5', 'request_id': 'req-f94b9122-1405-4587-a0f9-c81653d55b33'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.455688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:53.459706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a56daa3f57a340c3875951ba57a894c5', 'request_id': 'req-f94b9122-1405-4587-a0f9-c81653d55b33'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.476566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a56daa3f57a340c3875951ba57a894c5', 'request_id': 'req-f94b9122-1405-4587-a0f9-c81653d55b33'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.489227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] The token cache is being invalidate because project a56daa3f57a340c3875951ba57a894c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:53.489416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.490106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.491847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 899/1787] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:52 2022] DELETE /identity/v3/projects/a56daa3f57a340c3875951ba57a894c5 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:53.496223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:53.511850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaf61c-110f-40ab-a1f6-baaa43cab58d service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:53.666334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:53.667005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:53.667289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:53.667560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] PATH_INFO: `/v3/users/af2efb881f4e425fb38302a94203fe8a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:53.670703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2efb881f4e425fb38302a94203fe8a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:53.677585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:53.958915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:53.960449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:53.972593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2efb881f4e425fb38302a94203fe8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:53.997623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b9122-1405-4587-a0f9-c81653d55b33 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:54.031352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:54.032328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:54.036732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:54.036732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] PATH_INFO: `/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:54.036732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af3b47d5ee147f1a76a64de5bcaf43c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:54.041552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:54.077544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2efb881f4e425fb38302a94203fe8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.078439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2efb881f4e425fb38302a94203fe8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.079774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2efb881f4e425fb38302a94203fe8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.095497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f89ddc5-c831-4f2c-a1db-33c77d0c8652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2efb881f4e425fb38302a94203fe8a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.101336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:54.184695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 889/1788] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:00:53 2022] DELETE /identity/v3/users/af2efb881f4e425fb38302a94203fe8a => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:00:54.289812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af3b47d5ee147f1a76a64de5bcaf43c', 'request_id': 'req-10884c20-6a45-465d-9307-8d0f4a75b825'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.350391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af3b47d5ee147f1a76a64de5bcaf43c', 'request_id': 'req-10884c20-6a45-465d-9307-8d0f4a75b825'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.363331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af3b47d5ee147f1a76a64de5bcaf43c', 'request_id': 'req-10884c20-6a45-465d-9307-8d0f4a75b825'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.385070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] The token cache is being invalidate because project 2af3b47d5ee147f1a76a64de5bcaf43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:54.385625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.386607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-10884c20-6a45-465d-9307-8d0f4a75b825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:54.392523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 900/1789] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:53 2022] DELETE /identity/v3/projects/2af3b47d5ee147f1a76a64de5bcaf43c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:54.393952 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:54.394280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:54.395735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:54.434228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:54.437668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:54.534234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 890/1790] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:54.544166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:54.544166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:54.544166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:54.570803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:54.573800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:54.584473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 901/1791] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:54.588852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:54.603279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ab67-e42a-4964-ac9a-12ec0941a84a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:54.608900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:54.609889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:54.610468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:54.611005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:54.612078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:54.612683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:54.615878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:54.634732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 891/1792] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:00:54.636047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:54.647581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e171dfd-254e-4df1-bfa2-d8eaa64939fd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:54.653461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:54.654945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:54.655814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:54.656525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:54.657750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:54.660409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:54.837055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 902/1793] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:54 2022] POST /identity/v3/projects => generated 369 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:54.841644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:54.856542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91286c-44b1-4bee-9796-1375a9f494db admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:55.000464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:55.002885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.009965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:55.009965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.009965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.009965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:55.010471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:55.119035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 892/1794] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:54 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:55.122472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:55.135103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99930062-7a1b-4fa0-a921-0779719cf11e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:55.141155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:55.141957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.142460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.142878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.143795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:55.145654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:55.164228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 903/1795] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:55.170206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:55.208001 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2613f-1aef-4c1a-bcb6-3a8e003344e6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:55.222488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:55.225257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.226392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.226825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.228423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:55.235114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f0c15-3f35-4b56-99f7-59d710009487 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:55.285093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:55.285705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 893/1796] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:55.319503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b48170-4bc6-4d23-b524-bc3345deb44a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:55.328932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:55.330771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.331226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.331667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] PATH_INFO: `/v3/projects/3424bf720dc148cd91a746d0e801e1f0/users/05bd01fd11f449719b8b52743097d3a6/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.394549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3424bf720dc148cd91a746d0e801e1f0, user_id=05bd01fd11f449719b8b52743097d3a6, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:55.398222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:55.496922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 904/1797] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:55 2022] PUT /identity/v3/projects/3424bf720dc148cd91a746d0e801e1f0/users/05bd01fd11f449719b8b52743097d3a6/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:55.508961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.510042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.510478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.564783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] MFA Rules not processed for user `05bd01fd11f449719b8b52743097d3a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:55.567481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:55.762789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 894/1798] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:55.767800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:55.889518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e273-7960-41a9-ba89-11a5210d0ee6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:55.906921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:55.909086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:55.909086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:55.909086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:55.909086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:55.910839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.042105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 905/1799] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:55 2022] POST /identity/v3/projects => generated 367 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:56.047116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.083205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536d8c1-f192-412b-881c-f1b35e3a3ddc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:56.093973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.100636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:56.217501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:56.364915 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8792f93-b928-41a2-94e7-89c9855355ae admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:56.377556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:56.378607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.379091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.379534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] PATH_INFO: `/v3/projects/c86f67b254754f13bf8550ac9024100c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.381485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86f67b254754f13bf8550ac9024100c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:56.388518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.396664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:56.397717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.409000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.410746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.411625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:56.416604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.569449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 895/1800] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:56 2022] POST /identity/v3/users => generated 290 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:00:56.572616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.573732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86f67b254754f13bf8550ac9024100c', 'request_id': 'req-6c443b95-ee9e-45a0-8022-6f1a39a67431'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:56.609874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5b665-6dad-438f-84c4-9b60ee2f142d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:56.665035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86f67b254754f13bf8550ac9024100c', 'request_id': 'req-6c443b95-ee9e-45a0-8022-6f1a39a67431'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:56.675432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86f67b254754f13bf8550ac9024100c', 'request_id': 'req-6c443b95-ee9e-45a0-8022-6f1a39a67431'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:56.700586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] The token cache is being invalidate because project c86f67b254754f13bf8550ac9024100c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:00:56.701195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:56.702116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c443b95-ee9e-45a0-8022-6f1a39a67431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:00:56.712042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 906/1801] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:00:56 2022] DELETE /identity/v3/projects/c86f67b254754f13bf8550ac9024100c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:00:56.719257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd56ef-31a1-437c-b854-12d406c73cbb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.719702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd56ef-31a1-437c-b854-12d406c73cbb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.720251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd56ef-31a1-437c-b854-12d406c73cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.777280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:56.778904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.780285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.781849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.784306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:56.789297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.790375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-efcd56ef-31a1-437c-b854-12d406c73cbb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:56.792699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-efcd56ef-31a1-437c-b854-12d406c73cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:56.816604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 896/1802] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:56.821192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.823281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 907/1803] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:56.823629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:56.833462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.833732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.833986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.859631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efd433-4dd6-4532-bb0e-af7b18404cf9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:56.881826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:56.882633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.883095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.883459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] PATH_INFO: `/v3/projects/f85107adeaf1445da3e5bf49a020ebe9/users/c5df8d23d78c4ea08c5a0e452e2a5992/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.893547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:56.893752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:56.906363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85107adeaf1445da3e5bf49a020ebe9, user_id=c5df8d23d78c4ea08c5a0e452e2a5992, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:56.907794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.917668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 908/1804] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:56.923330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.942687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd183c22-62bf-44c1-9fc5-d3500196fad7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:56.949146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:56.949937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:56.950287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:56.950690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:56.951362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:00:56.951665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:56.953343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:56.971951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 909/1805] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:00:56.976550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:56.993392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf88a0-ad08-4865-aced-f844a9e3b31c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.000791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:57.000957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.001411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.001890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.002169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.002820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.005020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.017622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 897/1806] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:56 2022] PUT /identity/v3/projects/f85107adeaf1445da3e5bf49a020ebe9/users/c5df8d23d78c4ea08c5a0e452e2a5992/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:57.021925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.147328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 910/1807] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:56 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:57.150237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.202328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa303-00a4-4bd1-9c43-a749c469bde2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.330572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.331229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.331697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.332201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.333506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.354211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285fd3e-74f1-4d84-ba14-5e748c520c53 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.372071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.372883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.373176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.373458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.374127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.378349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.379886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.441879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 898/1808] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:57.445900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.484352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da9d451-0b2d-43cb-8634-abf28ec1b741 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.498278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 911/1809] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:57 2022] POST /identity/v3/users => generated 297 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:57.503569 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.503677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.503764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.504023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.504543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] PATH_INFO: `/v3/projects/f85107adeaf1445da3e5bf49a020ebe9/users/c5df8d23d78c4ea08c5a0e452e2a5992/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.509161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85107adeaf1445da3e5bf49a020ebe9, user_id=c5df8d23d78c4ea08c5a0e452e2a5992, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.512706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e32c7a-7cb6-456c-a577-92152e768c1a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.529617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2e53f3-dd7b-4440-bb2d-cdf50920de16 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.544521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 899/1810] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:57 2022] PUT /identity/v3/projects/f85107adeaf1445da3e5bf49a020ebe9/users/c5df8d23d78c4ea08c5a0e452e2a5992/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:57.559303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.560870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.564740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.642452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] MFA Rules not processed for user `c5df8d23d78c4ea08c5a0e452e2a5992`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:57.643703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:57.697505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.698544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.699009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.699943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.700976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.703281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.762435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 912/1811] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:57.764129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.797583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ea460-f75a-4ff8-9773-ac55f5536b20 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.812832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.813935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.814854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.815490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.817126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.819609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.836198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 913/1812] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:57.845376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.862137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 900/1813] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:57.863801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faa46d-10a0-4daf-ad93-ab46dea7d387 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:57.870307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:57.871017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:57.871296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:57.871569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] PATH_INFO: `/v3/projects/3001a7e0a315400d84fdd0e6af8f8ca2/users/0c5029e132094e50aec8ab6378d6db84/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:57.877741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:57.878513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:57.881443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:57.894486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3001a7e0a315400d84fdd0e6af8f8ca2, user_id=0c5029e132094e50aec8ab6378d6db84, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:57.897907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd0a5a-932b-42e7-9417-5d4ff4632109 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:57.995682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453206b-09a5-49b0-8f3a-1be945275daf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:58.004012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:58.004653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:58.004999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:58.005279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:58.016346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 914/1814] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:57 2022] PUT /identity/v3/projects/3001a7e0a315400d84fdd0e6af8f8ca2/users/0c5029e132094e50aec8ab6378d6db84/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:58.025253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:58.026671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:58.026966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:58.027254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:58.037167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:58.077845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 901/1815] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:00:58.150872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] MFA Rules not processed for user `0c5029e132094e50aec8ab6378d6db84`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:58.154350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:58.312143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 915/1816] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:58.313429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:58.332590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c948c4-8732-4b8d-9fa4-d8b1af2c819b service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:58.439292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:58.464136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:58.464136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:58.464136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:58.464574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:58.474999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:58.474999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:58.551507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeaee2a-e3e8-41af-95d3-dffd6a6a1a3b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:58.568731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:58.568731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:58.568731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:58.568731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:58.578797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:58.593890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 902/1817] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:00:58 2022] POST /identity/v3/projects => generated 393 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:58.598182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:58.712358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:58.745331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:58.746873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:58.780214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 916/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:00:58.818083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e236a6-31a5-40bc-b8f1-768cef0f6eee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:58.844199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:58.846098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:58.846618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:58.848113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:58.848819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:58.855718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:58.972376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 903/1819] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:00:58 2022] POST /identity/v3/users => generated 303 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:00:58.977483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:58.998925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa6835-ba86-4c27-9ebb-27607989aefd service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:59.017058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:59.017948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.021355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.021862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.023464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:59.025774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:59.056496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 917/1820] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:59.060164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:59.091763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb6e31-42df-46d9-9178-ada90e71c070 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:59.105945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:59.107363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.108033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.110296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] PATH_INFO: `/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0/users/5825e0510c6a4334843e00cbaa21996b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.164240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0a9a5efe7a46bc8555d0f750c0dab0, user_id=5825e0510c6a4334843e00cbaa21996b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:59.167622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52759231-074e-49da-99ba-9f90ce3c70c2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:59.254295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 904/1821] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:59 2022] PUT /identity/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0/users/5825e0510c6a4334843e00cbaa21996b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:59.258411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:59.273142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c39056-5d1c-4b4e-b13a-08fdf7f35e75 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:59.444795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:59.450015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.453143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.455025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.456234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:59.463427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:59.491630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a296f-6bc1-4bc9-a180-fe1b5b004144 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.491879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a296f-6bc1-4bc9-a180-fe1b5b004144 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.492312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a296f-6bc1-4bc9-a180-fe1b5b004144 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.493595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 905/1822] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:00:59.514186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.514473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:00:59.514578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.517076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.543600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 918/1823] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:00:59.552802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:59.568944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:59.570158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:59.587051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b39c-14d5-45e1-b788-99e08016bc94 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:59.596077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:59.596754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.598341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.598341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] PATH_INFO: `/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0/users/5825e0510c6a4334843e00cbaa21996b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.599778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0a9a5efe7a46bc8555d0f750c0dab0, user_id=5825e0510c6a4334843e00cbaa21996b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:59.603377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e77f74-032b-4f0b-b0e5-77c23f0c2b1f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:00:59.628647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 919/1824] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:00:59 2022] PUT /identity/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0/users/5825e0510c6a4334843e00cbaa21996b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:00:59.630402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.636223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.636223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.714948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] MFA Rules not processed for user `5825e0510c6a4334843e00cbaa21996b`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:00:59.719058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:59.723121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 906/1825] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:00:59.748542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:59.750540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:59.793778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e735c91-1613-4c53-9608-81a8f51cdb92 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:00:59.859792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 920/1826] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:00:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:00:59.935656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:00:59.936939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:00:59.964064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:00:59.964364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:00:59.964364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:00:59.964558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:00:59.985671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:00:59.993194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:00.018820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 907/1827] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:00.104037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4867a113-5037-4d7b-957e-0d02b4e3213b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:00.108958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:00.109510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:00.109806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:00.110082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:00.122326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:00.124709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:00.139151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 921/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:00:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:00.277642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:00.287591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16c0c3-3d83-4b66-a6d9-57f73c0aa284 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:00.294383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:00.295008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:00.295419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:00.295637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:00.375644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:00.377462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e9f2f-b186-4d26-88c8-cc38116f16cc service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:00.384874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:00.396625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 908/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:01.085752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:01.087422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:01.157654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a1f13-0eba-40ba-9cb8-febf127512b5 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:01.162666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:01.163309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:01.163596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:01.163874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] PATH_INFO: `/v3/users/5d7e1cc4fc9e46daaec073d3966a6f0c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:01.165034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7e1cc4fc9e46daaec073d3966a6f0c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:01.167799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:01.348052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7e1cc4fc9e46daaec073d3966a6f0c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:01.420467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7e1cc4fc9e46daaec073d3966a6f0c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:01.421660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7e1cc4fc9e46daaec073d3966a6f0c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:01.423034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7e1cc4fc9e46daaec073d3966a6f0c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:01.436121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7e1cc4fc9e46daaec073d3966a6f0c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:01.463549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 922/1830] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:01 2022] DELETE /identity/v3/users/5d7e1cc4fc9e46daaec073d3966a6f0c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:01.465208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:01.465662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:01.465754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:01.494890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:01.496247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:01.562242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 909/1831] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:01.576871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:01.580587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:01.648531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:01.654280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4f320-0db8-4985-8c2c-c3411c503806 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:01.658150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:01.659134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:01.659134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:01.659610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:01.682726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:01.685385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:01.703202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 923/1832] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:02.405865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:02.407385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:02.419610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c70d0f-5b4a-4fc2-9fbf-4fccd81a9a2b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:02.424619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:02.425223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:02.425508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:02.425784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] PATH_INFO: `/v3/projects/0f939fce9ae944018a383c1cc1144083` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:02.427025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f939fce9ae944018a383c1cc1144083)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:02.428958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:02.535611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f939fce9ae944018a383c1cc1144083', 'request_id': 'req-87a939f9-84ad-49d5-95d8-615239382acb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:02.541207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f939fce9ae944018a383c1cc1144083', 'request_id': 'req-87a939f9-84ad-49d5-95d8-615239382acb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:02.630590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f939fce9ae944018a383c1cc1144083', 'request_id': 'req-87a939f9-84ad-49d5-95d8-615239382acb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:02.644087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] The token cache is being invalidate because project 0f939fce9ae944018a383c1cc1144083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:02.644422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:02.645314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:02.646977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 910/1833] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:02 2022] DELETE /identity/v3/projects/0f939fce9ae944018a383c1cc1144083 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:02.651626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:02.662676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f00c7-f724-4c80-8583-74e37db9028d service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:02.756502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:02.760881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:02.760881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:02.760881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] PATH_INFO: `/v3/users/319729c0add6450abdd5c1011110ac9b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:02.761262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] RBAC: Authorizing `identity:delete_user(user_id=319729c0add6450abdd5c1011110ac9b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:02.799138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:03.789411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319729c0add6450abdd5c1011110ac9b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:03.795901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:03.886602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319729c0add6450abdd5c1011110ac9b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:03.887241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319729c0add6450abdd5c1011110ac9b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:03.887862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319729c0add6450abdd5c1011110ac9b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:03.895616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319729c0add6450abdd5c1011110ac9b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:03.914478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 924/1834] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:02 2022] DELETE /identity/v3/users/319729c0add6450abdd5c1011110ac9b => generated 0 bytes in 1263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:04.522118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:04.658666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:04.670647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:04.691314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a939f9-84ad-49d5-95d8-615239382acb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:04.764154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:04.764892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:04.765285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:04.765656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] PATH_INFO: `/v3/projects/0dc2131cd93941058e8b577a44322292` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:04.767179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc2131cd93941058e8b577a44322292)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:04.769616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:04.917645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc2131cd93941058e8b577a44322292', 'request_id': 'req-fbec76c9-0c94-4251-ac21-b4774eb04958'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:04.924481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc2131cd93941058e8b577a44322292', 'request_id': 'req-fbec76c9-0c94-4251-ac21-b4774eb04958'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.013005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc2131cd93941058e8b577a44322292', 'request_id': 'req-fbec76c9-0c94-4251-ac21-b4774eb04958'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.024441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] The token cache is being invalidate because project 0dc2131cd93941058e8b577a44322292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:05.024836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.025636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fbec76c9-0c94-4251-ac21-b4774eb04958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.030463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 911/1835] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:04 2022] DELETE /identity/v3/projects/0dc2131cd93941058e8b577a44322292 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:05.030799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.032299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.032888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec2fa-c880-43a7-ab09-2ab7f5cc702c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.033332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec2fa-c880-43a7-ab09-2ab7f5cc702c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.033809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec2fa-c880-43a7-ab09-2ab7f5cc702c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.045741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b27f8-d666-46d7-b1a4-04c5435509af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.056870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2dec2fa-c880-43a7-ab09-2ab7f5cc702c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:05.058082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2dec2fa-c880-43a7-ab09-2ab7f5cc702c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.110719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.111727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.112033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.112310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] PATH_INFO: `/v3/users/05bd01fd11f449719b8b52743097d3a6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.113744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05bd01fd11f449719b8b52743097d3a6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.115421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.123194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 912/1836] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:05.131126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.134449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.134449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.152324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:05.153534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.161479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 913/1837] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:05.165597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.176370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9bd2-ab3f-4fd1-8e80-0ef40b855bca None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.182158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.182753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.183029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.183297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.184022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:05.184326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.185942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.198398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 914/1838] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:05.202772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.212406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca86cc-6dd4-4663-8dae-08d88b001a0d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.217386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.217641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.217929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.218205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.218824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.220745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.329178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 915/1839] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:05.333253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.360766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05bd01fd11f449719b8b52743097d3a6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.398458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a81940-781e-4918-888f-ddd94229440b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.403474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.404168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.404448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.404725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.406064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.408216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.430042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05bd01fd11f449719b8b52743097d3a6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.430662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05bd01fd11f449719b8b52743097d3a6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.431909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05bd01fd11f449719b8b52743097d3a6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.439381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-941ebac1-1c4c-455d-93e2-cfba29c7dd14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05bd01fd11f449719b8b52743097d3a6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:05.456951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 925/1840] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:05 2022] DELETE /identity/v3/users/05bd01fd11f449719b8b52743097d3a6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:05.461588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.461964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.462250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.482648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:05.485745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.515751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 916/1841] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:05.520152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.522304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.535045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d000796-4862-4cbb-9c12-b66caeaf1d78 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.559727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 926/1842] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:05.570208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.571785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.619603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.620976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.621328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.621787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.622865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.625576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.644990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 917/1843] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:05.646137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.662535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411daae-dc16-45fc-9090-35e23ab37b68 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.663954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635eb24-59eb-43be-94e5-f2108e4cc14d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.668891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.669751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.669888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.670083 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.670498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.671024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.671435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.672170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.684217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.685842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.685974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa25e-d969-4369-ab25-ca02c54031a4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.687510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.699849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 927/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:05.713395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:05.716979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 918/1845] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:05.725374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac24d1d-9ce2-472d-9a25-f29551e09f51 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:05.733061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:05.733960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.734072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.734489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] PATH_INFO: `/v3/projects/e3d7c22b964d4f18983f4953e60ee164/users/e64a0bfd967743f0be36ba1ed67ff59e/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.756721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d7c22b964d4f18983f4953e60ee164, user_id=e64a0bfd967743f0be36ba1ed67ff59e, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:05.761698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:05.898504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 928/1846] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:05 2022] PUT /identity/v3/projects/e3d7c22b964d4f18983f4953e60ee164/users/e64a0bfd967743f0be36ba1ed67ff59e/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:05.906193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe275-d2aa-43ee-8af6-10865b7e31e6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:05.906484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe275-d2aa-43ee-8af6-10865b7e31e6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:05.906774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfe275-d2aa-43ee-8af6-10865b7e31e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:05.945646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bacfe275-d2aa-43ee-8af6-10865b7e31e6 None None] MFA Rules not processed for user `e64a0bfd967743f0be36ba1ed67ff59e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:05.947820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bacfe275-d2aa-43ee-8af6-10865b7e31e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:05.970445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:06.034655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 919/1847] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:06.039825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.073140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2efd6-d8ba-42f7-8afc-0d9551e89b4b None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.084441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2efd6-d8ba-42f7-8afc-0d9551e89b4b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.084698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2efd6-d8ba-42f7-8afc-0d9551e89b4b None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.089716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 920/1848] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:01:06 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:01:06.112409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.113221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.113221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.149252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8674f3-cc7c-4865-bdda-c5ed57ed0dbb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.151513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:06.154421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.158634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.159480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.159943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.160705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.161493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.164060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.277223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 921/1849] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:06.292804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.294238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.304982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 929/1850] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:06 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:06.320139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.337579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64a94-951c-4489-9c44-527cf29fbb1e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.412633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93e4af-57ae-4830-ab00-eba028bd538f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.418209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.425663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.425663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.425663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.425663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.425663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.432872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.433604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.433954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.434231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.444906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.449134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.465088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 922/1851] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:06.466053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.467410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.481674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9f831-e9b1-4a55-ac1a-c763aa2d55d6 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.486442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.487083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.487366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.487699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] PATH_INFO: `/v3/projects/3424bf720dc148cd91a746d0e801e1f0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.488899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3424bf720dc148cd91a746d0e801e1f0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.491355 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.538069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 930/1852] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:06 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:06.539159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.541000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.553038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedcdef-4f70-4a87-8179-69290d271730 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.558368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.558993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.559270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.559544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] PATH_INFO: `/v3/users/0c5029e132094e50aec8ab6378d6db84` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.560689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5029e132094e50aec8ab6378d6db84)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.562657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.625447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3424bf720dc148cd91a746d0e801e1f0', 'request_id': 'req-68b3eaef-3297-476c-9b78-0708acb98f4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.630846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3424bf720dc148cd91a746d0e801e1f0', 'request_id': 'req-68b3eaef-3297-476c-9b78-0708acb98f4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.740205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3424bf720dc148cd91a746d0e801e1f0', 'request_id': 'req-68b3eaef-3297-476c-9b78-0708acb98f4f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.752600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] The token cache is being invalidate because project 3424bf720dc148cd91a746d0e801e1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:06.752896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.753560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.755091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 923/1853] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:06 2022] DELETE /identity/v3/projects/3424bf720dc148cd91a746d0e801e1f0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:06.755900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.757385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.817854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:06.826832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3eaef-3297-476c-9b78-0708acb98f4f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.832218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.832834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.833124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.833399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.834042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.834742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5029e132094e50aec8ab6378d6db84'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.835648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.850741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 924/1854] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:06.850741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.850741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:06.864459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e016a8f-e4bc-4f8d-9094-047905ec4ef3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:06.870349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:06.870980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:06.871260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:06.871535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] PATH_INFO: `/v3/users/c5df8d23d78c4ea08c5a0e452e2a5992` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:06.872693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5df8d23d78c4ea08c5a0e452e2a5992)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:06.874595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:06.906301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5029e132094e50aec8ab6378d6db84'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.906969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5029e132094e50aec8ab6378d6db84'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.907573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5029e132094e50aec8ab6378d6db84'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.915504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5029e132094e50aec8ab6378d6db84'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:06.935001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 931/1855] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:06 2022] DELETE /identity/v3/users/0c5029e132094e50aec8ab6378d6db84 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:06.936275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:06.937383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.010907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1db7b5-aaf8-4eff-b305-920796dd1ea0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.021204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.022392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.022392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.022392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.023827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.025544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d198ddae-e542-4551-acf9-0f8e004a02cd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.039964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 932/1856] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:07.043835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.044298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.044583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.062177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5df8d23d78c4ea08c5a0e452e2a5992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:07.069029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:07.070722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.081881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 933/1857] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:07.081881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.093495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ac049-1b67-4221-9155-62727b5b1949 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.098301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.099291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.099411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.099592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] PATH_INFO: `/v3/projects/17d74ef57c1148d8a50fd77a10e5d121/users/bb7d6426ffad4f41b59caf878f774645/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.115933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d74ef57c1148d8a50fd77a10e5d121, user_id=bb7d6426ffad4f41b59caf878f774645, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.119253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60550b-98a7-40ff-8d52-210bfb488c44 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.129180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5df8d23d78c4ea08c5a0e452e2a5992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:07.129914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5df8d23d78c4ea08c5a0e452e2a5992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:07.131218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5df8d23d78c4ea08c5a0e452e2a5992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:07.148150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5df8d23d78c4ea08c5a0e452e2a5992'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:07.170977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 925/1858] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:06 2022] DELETE /identity/v3/users/c5df8d23d78c4ea08c5a0e452e2a5992 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:07.170977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.172555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.205725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 934/1859] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:07 2022] PUT /identity/v3/projects/17d74ef57c1148d8a50fd77a10e5d121/users/bb7d6426ffad4f41b59caf878f774645/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:07.219383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.220262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.220409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.255519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] MFA Rules not processed for user `bb7d6426ffad4f41b59caf878f774645`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:07.256985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.270429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adce2b1-05c7-4437-a51a-e632e661a575 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.367173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.368193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.368702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.369634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.371501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.392296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 935/1860] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:07.396777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.413398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.459957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.462554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.474611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 926/1861] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:07.563013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ee29-916b-4974-b0c7-21b36b21a8a0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.568605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.572318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.572318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.572318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.572318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.575059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.723016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 936/1862] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:07 2022] POST /identity/v3/projects => generated 385 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:07.729843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.740518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b17e8-6e2d-43b1-b743-29a4e3dca102 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.817523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.818228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.819841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.820163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.820828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.823650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.932892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.934254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:07.943992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 927/1863] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:07 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:07.945140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:07.960631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a2a6a-6df6-4cd4-80db-37f2f6e9ebb4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.963614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251f86-f265-42de-af86-1142955751a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:07.970113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.971168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.971872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.972308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] PATH_INFO: `/v3/projects/f85107adeaf1445da3e5bf49a020ebe9` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.973578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85107adeaf1445da3e5bf49a020ebe9)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.976058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:07.980862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:07.981805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:07.983230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:07.983731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:07.984617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:07.986878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.001795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:08.021540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 928/1864] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:08.031071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.039033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89b971-5fcd-4a75-b9f2-75e3b4611bb7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.048196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.050075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.051050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.051330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] PATH_INFO: `/v3/projects/5236d794a725441aa4a858839f41a8e5/users/4197fc761bac43b8b06b36892bfe6339/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.069091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5236d794a725441aa4a858839f41a8e5, user_id=4197fc761bac43b8b06b36892bfe6339, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.073125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.145671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 929/1865] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:08 2022] PUT /identity/v3/projects/5236d794a725441aa4a858839f41a8e5/users/4197fc761bac43b8b06b36892bfe6339/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:08.149712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.157279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85107adeaf1445da3e5bf49a020ebe9', 'request_id': 'req-90bd037f-0461-4c20-be6e-906a93aecf74'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.211512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cedce-40c7-4e56-a89a-f5dd3cf1163a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.229932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85107adeaf1445da3e5bf49a020ebe9', 'request_id': 'req-90bd037f-0461-4c20-be6e-906a93aecf74'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.240962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85107adeaf1445da3e5bf49a020ebe9', 'request_id': 'req-90bd037f-0461-4c20-be6e-906a93aecf74'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.263560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] The token cache is being invalidate because project f85107adeaf1445da3e5bf49a020ebe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:08.263891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.264724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.266626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 937/1866] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:07 2022] DELETE /identity/v3/projects/f85107adeaf1445da3e5bf49a020ebe9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:08.268725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.270912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.274585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.275356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.275770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.276141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.277162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.279038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abec84-840e-42c5-835e-f6fbf54fe237 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.285414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd037f-0461-4c20-be6e-906a93aecf74 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.289857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 930/1867] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:08.291221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.291509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.291787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.293916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.294647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.295514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.296139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] PATH_INFO: `/v3/projects/3001a7e0a315400d84fdd0e6af8f8ca2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.297298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3001a7e0a315400d84fdd0e6af8f8ca2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.299614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.315574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:08.317096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.332064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 931/1868] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:08.333132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.334562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.350178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662408f8-1f43-4c10-b2ee-f33e44c115fb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.357045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.357045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.357045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.357045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] PATH_INFO: `/v3/projects/5236d794a725441aa4a858839f41a8e5/users/4197fc761bac43b8b06b36892bfe6339/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.358675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5236d794a725441aa4a858839f41a8e5, user_id=4197fc761bac43b8b06b36892bfe6339, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.361811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536db60f-73a7-4c79-b7c7-297ed01608c7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.377530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 932/1869] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:08 2022] PUT /identity/v3/projects/5236d794a725441aa4a858839f41a8e5/users/4197fc761bac43b8b06b36892bfe6339/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:08.377530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303888c5-625f-4e9e-a6b6-475762d30df5 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.377530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303888c5-625f-4e9e-a6b6-475762d30df5 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.377530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303888c5-625f-4e9e-a6b6-475762d30df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.403238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-303888c5-625f-4e9e-a6b6-475762d30df5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:08.404606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-303888c5-625f-4e9e-a6b6-475762d30df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.436062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3001a7e0a315400d84fdd0e6af8f8ca2', 'request_id': 'req-6c66b566-5fd3-48e0-96ef-b004da25bf40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.478139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 933/1870] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:08.480140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.480140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.480140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.508547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] MFA Rules not processed for user `4197fc761bac43b8b06b36892bfe6339`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:08.509889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.528513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3001a7e0a315400d84fdd0e6af8f8ca2', 'request_id': 'req-6c66b566-5fd3-48e0-96ef-b004da25bf40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.541174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3001a7e0a315400d84fdd0e6af8f8ca2', 'request_id': 'req-6c66b566-5fd3-48e0-96ef-b004da25bf40'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.562391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] The token cache is being invalidate because project 3001a7e0a315400d84fdd0e6af8f8ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:08.562719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.564011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:08.568901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 938/1871] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:08 2022] DELETE /identity/v3/projects/3001a7e0a315400d84fdd0e6af8f8ca2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:08.568901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.570002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.624258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 934/1872] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:08.625651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.629256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.662208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66b566-5fd3-48e0-96ef-b004da25bf40 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.668220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.668894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.669175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.669727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.670398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:08.671244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.673300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.692662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 939/1873] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:08.692662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.696812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:08.721211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77bc5a-2e0a-44ea-b1aa-9cd20bcb4be6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.728166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.729031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.731315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.731603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] PATH_INFO: `/v3/users/5825e0510c6a4334843e00cbaa21996b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.733101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5825e0510c6a4334843e00cbaa21996b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.739158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.768338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a53817-66a8-4bb4-932c-a03802ce51ac admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.772733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.775296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.775296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.775296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.787590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.789820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.804569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 940/1874] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:08.819746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:08.836646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791a34b-67a2-4775-94ea-fac7939202b0 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:08.844078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:08.844926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:08.845056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:08.845339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:08.846031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:08.848072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:08.926196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5825e0510c6a4334843e00cbaa21996b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.002160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 941/1875] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:08 2022] POST /identity/v3/projects => generated 389 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:09.003411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.006421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5825e0510c6a4334843e00cbaa21996b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.007016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5825e0510c6a4334843e00cbaa21996b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.008193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5825e0510c6a4334843e00cbaa21996b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.016730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5825e0510c6a4334843e00cbaa21996b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.044229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 935/1876] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:08 2022] DELETE /identity/v3/users/5825e0510c6a4334843e00cbaa21996b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:09.082851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bb870-e7e9-428c-b2a7-fcdd9081eb83 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.164578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.165314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.165794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.166175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.166816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.168786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.304204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 942/1877] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:09 2022] POST /identity/v3/users => generated 295 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:09.306063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.308121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:09.324076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201ba489-59fd-42bc-b37d-af1f07e08c87 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.333403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.335909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.335909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.335909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.335909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.336961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.375117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 936/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:09.375583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.389040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b67e-5c80-4784-a944-0e9954ba40ef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.395497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.396795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.397074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.397350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.398025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.400160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9e02b-4e3f-46b0-9f88-cb051a9fc667 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.418197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 943/1879] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:09.426152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.437652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675a92a-5c29-452f-b311-8974138b2592 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.443995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.444761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.445055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.447832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] PATH_INFO: `/v3/projects/d117c170e31b46838fb96f08171cf7d0/users/95c55b45e5834d38bbda1cfd165491b1/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.465448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d117c170e31b46838fb96f08171cf7d0, user_id=95c55b45e5834d38bbda1cfd165491b1, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.469707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.545687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 937/1880] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:09 2022] PUT /identity/v3/projects/d117c170e31b46838fb96f08171cf7d0/users/95c55b45e5834d38bbda1cfd165491b1/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:09.556790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.557724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.558023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.587849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] MFA Rules not processed for user `95c55b45e5834d38bbda1cfd165491b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:09.589112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:09.627395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.634883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:09.691825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 944/1881] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:09.696356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.737630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a9cd-031f-4d48-a12e-be6b0ab8a890 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.743019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.744393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.744674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.744946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] PATH_INFO: `/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.746106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0a9a5efe7a46bc8555d0f750c0dab0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.748049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.777931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4408-ac19-40f0-9b47-37f80b1006ee None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:09.784878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:09.785780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:09.786163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:09.786498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:09.787201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:09.789235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:09.894722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 945/1882] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:09 2022] POST /identity/v3/projects => generated 389 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:09.898656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:09.922129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0a9a5efe7a46bc8555d0f750c0dab0', 'request_id': 'req-58044795-7970-42f1-b320-cc0b1d541908'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.931972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0a9a5efe7a46bc8555d0f750c0dab0', 'request_id': 'req-58044795-7970-42f1-b320-cc0b1d541908'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:09.964431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:10.024262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0a9a5efe7a46bc8555d0f750c0dab0', 'request_id': 'req-58044795-7970-42f1-b320-cc0b1d541908'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:10.032640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87d19a-c385-45a5-b207-156874d1dc3d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.044296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] The token cache is being invalidate because project 8c0a9a5efe7a46bc8555d0f750c0dab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:10.044663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:10.045984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-58044795-7970-42f1-b320-cc0b1d541908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:10.052265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:10.054113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 938/1883] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:09 2022] DELETE /identity/v3/projects/8c0a9a5efe7a46bc8555d0f750c0dab0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:10.059957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.060433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.061180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.098172 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:10.100724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.166051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.168858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.169822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.170462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.171421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.173846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b603440-3e5c-45e7-a0f3-a82919054e6e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.218961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 939/1884] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:10.219769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.221712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.296835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 946/1885] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:09 2022] POST /identity/v3/users => generated 301 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:10.298309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.298611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.299397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.304786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3561fd67-ea54-42de-89ed-fc91df7cf90f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.313287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.316343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.316343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.316343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.317060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.324947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:10.326235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.339331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 947/1886] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:10.339331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.339331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.350398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69b166a-40fa-4deb-8e03-dc983e025ffa None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.357037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.357911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.358185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.358466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.359178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.361016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.377161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 948/1887] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:10.377161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.395270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94d7e1-5a5c-4880-a9a1-9fda115216bc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.401533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.402157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.402435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.402708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.403737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:10.404026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.405710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.414854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.417485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.420195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 949/1888] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:10.421252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.436059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 940/1889] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:10.436904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.437050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b29c3-a579-401a-975c-232cb810ff9a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.442489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.443256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.443669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.443972 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] PATH_INFO: `/v3/projects/41865e6e58614851b6ee421b21eb8a73/users/b8f2744fde504ad1a2a25c14b9ea8118/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.449652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85ad30-5d12-47fa-be31-a1b567de5dbb service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.464332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.464332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.464332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.464332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.464689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.464689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.464828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41865e6e58614851b6ee421b21eb8a73, user_id=b8f2744fde504ad1a2a25c14b9ea8118, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.464828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.528583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 950/1890] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:10 2022] PUT /identity/v3/projects/41865e6e58614851b6ee421b21eb8a73/users/b8f2744fde504ad1a2a25c14b9ea8118/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:10.532376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.575775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 941/1891] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:10 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:10.579662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.622391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55866612-3498-44ac-825a-e21ecf157c03 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.666388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df258a-8c5a-480e-b760-537a47ae32ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.671317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.672061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.672352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.672632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.673269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.675284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.680304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.681458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.681738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.682013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.682652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.684278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.695022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 951/1892] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:10.699211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.708698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c2318-c566-441e-9822-65c14a9e65a7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.713294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.713917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.714195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.714468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] PATH_INFO: `/v3/projects/41865e6e58614851b6ee421b21eb8a73/users/b8f2744fde504ad1a2a25c14b9ea8118/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.716711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41865e6e58614851b6ee421b21eb8a73, user_id=b8f2744fde504ad1a2a25c14b9ea8118, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.719519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99483a0-3f0f-4d62-ad99-93203f21f8b5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.731965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 952/1893] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:10 2022] PUT /identity/v3/projects/41865e6e58614851b6ee421b21eb8a73/users/b8f2744fde504ad1a2a25c14b9ea8118/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:10.742870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.743725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.744040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.772552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] MFA Rules not processed for user `b8f2744fde504ad1a2a25c14b9ea8118`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:10.789766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:10.818886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 942/1894] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:10 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:10.821434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.840267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5e711-54e7-46c6-a624-6475fe842fbb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:10.943634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:10.944193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:10.944731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:10.945069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:10.945849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:10.947622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:10.967509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 943/1895] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:10.969104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:10.969611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 953/1896] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:10 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:11.000399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb1a17-85c0-48cc-bed8-2b0652b6107d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.017529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.017529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.017529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.017529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.018113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.020194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.043154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 944/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:11.047145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.061067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d7850-4111-466c-b618-b059c3a1a3a7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.067834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.068561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.068847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.069123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] PATH_INFO: `/v3/projects/b950fc8d0f0d46bd848f1a68749f41b2/users/8db1f8e819ed49c59ba8f789a2422cdf/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.084856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b950fc8d0f0d46bd848f1a68749f41b2, user_id=8db1f8e819ed49c59ba8f789a2422cdf, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.088675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f262a74-2c51-4619-a888-527ff81c26b3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.166977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.168910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:11.184413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 954/1898] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:11 2022] PUT /identity/v3/projects/b950fc8d0f0d46bd848f1a68749f41b2/users/8db1f8e819ed49c59ba8f789a2422cdf/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:11.196416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.196703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.196980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.241527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] MFA Rules not processed for user `8db1f8e819ed49c59ba8f789a2422cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:11.244511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:11.262164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c53c9-24e3-4ec6-aed2-c52815cc84b6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.327565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.330363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.330790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.331237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.357661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 955/1899] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:11.363302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.456939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.464080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.478995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 945/1900] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:11.498635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143589f-15bb-4e8e-ba7e-cc3a4127429e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.506068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.506692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.506976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.507254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.507892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.510520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.629392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.643120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 956/1901] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:11 2022] POST /identity/v3/projects => generated 385 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:11.646877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.655783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578046e9-0258-4d0f-89f4-c22627480ec5 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.739048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.740102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.740556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.740997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] PATH_INFO: `/v3/users/95c55b45e5834d38bbda1cfd165491b1` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.741517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d723af-90d0-4052-b10e-8a2822743ca5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.742544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c55b45e5834d38bbda1cfd165491b1)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.745562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.747136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.747827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.748131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.748539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.749298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.751457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.921416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 957/1902] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:11 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:11.923206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.934393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117f1fe-e783-47f8-83a3-a04de8d235d2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.939663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.940327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.941336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.941336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:11.943686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:11.943686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:11.961497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 958/1903] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:11.962713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:11.974735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6a23f-1454-41a1-a8f5-1f7c33990ec8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:11.979685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:11.981133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:11.981420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:11.981838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] PATH_INFO: `/v3/projects/d2aaaaf04a7540a39862f03bb23a812d/users/8182fc185f5f4890aef5752b204c0551/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.000495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aaaaf04a7540a39862f03bb23a812d, user_id=8182fc185f5f4890aef5752b204c0551, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:12.005982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:12.034274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c55b45e5834d38bbda1cfd165491b1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:12.115306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 959/1904] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:11 2022] PUT /identity/v3/projects/d2aaaaf04a7540a39862f03bb23a812d/users/8182fc185f5f4890aef5752b204c0551/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:12.117161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:12.128773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c55b45e5834d38bbda1cfd165491b1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:12.129458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c55b45e5834d38bbda1cfd165491b1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:12.130089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c55b45e5834d38bbda1cfd165491b1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:12.143830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16c37adb-2720-4f6c-9971-70276e625e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c55b45e5834d38bbda1cfd165491b1'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:12.167587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 946/1905] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:11 2022] DELETE /identity/v3/users/95c55b45e5834d38bbda1cfd165491b1 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:12.171117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.171579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.171860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.203086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:12.204423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:12.250449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ef7d-bd78-4452-9ded-2e354a42c13e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:12.285605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 947/1906] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:12.296439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:12.298555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:12.326042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:12.340378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:12.341202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.341733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.342499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.343528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:12.346458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:12.361633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 960/1907] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:12.366087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:12.371161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:12.391067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f10d6-7572-4edc-8b47-41472d00258a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:12.401717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:12.403691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.403691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.405161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e230bdf-6c22-4b49-b61c-715eb4b6abab admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:12.405645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.418793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:12.418793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.419076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.419295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] PATH_INFO: `/v3/projects/d2aaaaf04a7540a39862f03bb23a812d/users/8182fc185f5f4890aef5752b204c0551/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.422699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aaaaf04a7540a39862f03bb23a812d, user_id=8182fc185f5f4890aef5752b204c0551, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:12.433794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:12.434996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f4215-c0d6-44ea-a2a2-1a780486fc7b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:12.435267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:12.456354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 961/1908] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:12 2022] PUT /identity/v3/projects/d2aaaaf04a7540a39862f03bb23a812d/users/8182fc185f5f4890aef5752b204c0551/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:12.464633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.464928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.465200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.481597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 948/1909] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:12.538465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] MFA Rules not processed for user `8182fc185f5f4890aef5752b204c0551`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:12.539752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:12.636348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 962/1910] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:12.649879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:12.651959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:12.725887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea346a4a-4ed6-4097-8242-6ea9beab6a46 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:12.798013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:12.798999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:12.799389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:12.800331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:12.823522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:12.824703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:12.845808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 949/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:12.992369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:13.001324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:13.003248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:13.078386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8cc6da-5365-45e9-9596-b38844553de0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:13.083182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:13.083990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:13.084278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:13.084551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] PATH_INFO: `/v3/projects/d117c170e31b46838fb96f08171cf7d0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:13.085745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d117c170e31b46838fb96f08171cf7d0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:13.088331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:13.223488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd117c170e31b46838fb96f08171cf7d0', 'request_id': 'req-e8468e82-3b79-47d8-9d08-aa16c86796bf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.414575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd117c170e31b46838fb96f08171cf7d0', 'request_id': 'req-e8468e82-3b79-47d8-9d08-aa16c86796bf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.423293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd117c170e31b46838fb96f08171cf7d0', 'request_id': 'req-e8468e82-3b79-47d8-9d08-aa16c86796bf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.435877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] The token cache is being invalidate because project d117c170e31b46838fb96f08171cf7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:13.436666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.437040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.438885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 963/1912] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:13 2022] DELETE /identity/v3/projects/d117c170e31b46838fb96f08171cf7d0 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:13.443032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:13.454294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad15a1e-5826-4578-b277-24fe720b5bef service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:13.534834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:13.535635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:13.538037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:13.538037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] PATH_INFO: `/v3/users/b8f2744fde504ad1a2a25c14b9ea8118` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:13.538037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f2744fde504ad1a2a25c14b9ea8118)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:13.540223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:13.795398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f2744fde504ad1a2a25c14b9ea8118'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.853421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f2744fde504ad1a2a25c14b9ea8118'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.854567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f2744fde504ad1a2a25c14b9ea8118'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.857333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f2744fde504ad1a2a25c14b9ea8118'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.869181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-71a766ed-19d4-46e8-8de0-95db9cf1b2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f2744fde504ad1a2a25c14b9ea8118'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:13.895946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 950/1913] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:13 2022] DELETE /identity/v3/users/b8f2744fde504ad1a2a25c14b9ea8118 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:14.197640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:14.472403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:14.472403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:14.495824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8468e82-3b79-47d8-9d08-aa16c86796bf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:14.601437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:14.602148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:14.602460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:14.602733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] PATH_INFO: `/v3/projects/41865e6e58614851b6ee421b21eb8a73` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:14.604241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41865e6e58614851b6ee421b21eb8a73)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:14.606537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:14.779906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41865e6e58614851b6ee421b21eb8a73', 'request_id': 'req-d4176c23-8f88-4c86-89a6-ed28f5ea493f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:14.849874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41865e6e58614851b6ee421b21eb8a73', 'request_id': 'req-d4176c23-8f88-4c86-89a6-ed28f5ea493f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:14.862919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41865e6e58614851b6ee421b21eb8a73', 'request_id': 'req-d4176c23-8f88-4c86-89a6-ed28f5ea493f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:14.880429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] The token cache is being invalidate because project 41865e6e58614851b6ee421b21eb8a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:14.880681 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:14.881506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:14.883538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 964/1914] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:14 2022] DELETE /identity/v3/projects/41865e6e58614851b6ee421b21eb8a73 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:14.890538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac294c-c6cb-4369-bbc6-ea2b895f3af1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:14.891063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac294c-c6cb-4369-bbc6-ea2b895f3af1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:14.891395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac294c-c6cb-4369-bbc6-ea2b895f3af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:14.912263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5dac294c-c6cb-4369-bbc6-ea2b895f3af1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:14.913543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5dac294c-c6cb-4369-bbc6-ea2b895f3af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:14.962452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:14.964449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:15.051020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 951/1915] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:15.059948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.060362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.061567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.098245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4176c23-8f88-4c86-89a6-ed28f5ea493f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.104541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.105313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.106111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.106492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] PATH_INFO: `/v3/users/8db1f8e819ed49c59ba8f789a2422cdf` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.107876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db1f8e819ed49c59ba8f789a2422cdf)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.110251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.115333 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:15.116648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:15.134616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 952/1916] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:15.138959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.150397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1209f352-ac75-4f52-a7a9-830acde6bcdc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.156523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.158198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.158198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.158491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.159273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:15.159721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.161384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.178645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 953/1917] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:15.183601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.194332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaaf5a-07ea-4417-9aa7-c1df850b1973 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.199758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.203299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.203299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.203299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.203299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.203929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.323804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 954/1918] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:15 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:15.325442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.438869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db1f8e819ed49c59ba8f789a2422cdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:15.458205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0b8cf-b335-449b-b609-fa195033f9d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.486583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.488326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.488326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.488326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.489000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.491098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.506776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:15.528856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db1f8e819ed49c59ba8f789a2422cdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:15.530123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db1f8e819ed49c59ba8f789a2422cdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:15.531046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db1f8e819ed49c59ba8f789a2422cdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:15.542794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d54913cb-cdd2-4fc2-b7f4-5b68d6a42b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db1f8e819ed49c59ba8f789a2422cdf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:15.562238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 965/1919] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:14 2022] DELETE /identity/v3/users/8db1f8e819ed49c59ba8f789a2422cdf => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:15.567289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.567680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.568002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.589131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 955/1920] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:15 2022] POST /identity/v3/users => generated 290 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:15.590365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.590506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:15.591618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:15.599676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:15.617316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b656a4a-6972-49b2-808f-b8d1136ccb6c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.666773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 966/1921] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:15.700439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.701058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.701348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.701621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.702270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.704056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.704516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.705503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:15.717650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 956/1922] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:15.722361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.736591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d088da-4e9b-4307-84b7-cb3ee84994f6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.742629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.743704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.743826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.749356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.749356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.749356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.763659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 957/1923] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:15.764596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:15.784130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e13d178-b1ba-4106-b3a9-916f2d914b98 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.795071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.797338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.800955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.800955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.801152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a456ac2f-4b72-4a7e-b90f-622f8803ea98 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:15.811886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:15.812760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.813043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.813332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] PATH_INFO: `/v3/projects/cfa56374a867420eaf7b4ef332d17671/users/7ba00d9286d14fa285134bf71980be1c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:15.824820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.829818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d4969-88d4-4b3a-bd0a-ad0afbce24d4 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.846105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 967/1924] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:15.847627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfa56374a867420eaf7b4ef332d17671, user_id=7ba00d9286d14fa285134bf71980be1c, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:15.850490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:15.988024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 958/1925] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:15 2022] PUT /identity/v3/projects/cfa56374a867420eaf7b4ef332d17671/users/7ba00d9286d14fa285134bf71980be1c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:15.991548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:15.992174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:15.992174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.047835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] MFA Rules not processed for user `7ba00d9286d14fa285134bf71980be1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:16.049141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:16.124554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:16.138249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 968/1926] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:16.143118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.176052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.179103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:16.263871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c31cd6-005c-4817-818a-9f78d0c87847 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:16.270642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:16.271613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:16.276231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:16.276231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.276231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:16.276231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:16.277509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22d6d7-ab36-47a4-9c32-628fea1548e8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:16.282860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:16.283494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:16.283863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:16.284676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.286609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:16.393163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 959/1927] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:16 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:16.397226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.467696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:16.469675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:16.492795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 969/1928] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:16.514304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687adc9-16c2-4f22-a290-bc829baf87da admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:16.527453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:16.529032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:16.529258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:16.529530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.531381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:16.540709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:16.672856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 960/1929] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:16 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:16.677646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.699794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feae632-b4ee-48da-92cb-b078c80f2d02 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:16.722857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:16.723896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:16.724303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:16.725346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.726111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:16.728769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:16.760997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 970/1930] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:16.764709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.775525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac624c-a3d4-4ab1-8dbc-0717c4bef0fd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:16.790502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:16.791813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:16.793434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:16.793434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] PATH_INFO: `/v3/projects/a1cc9090ecaa4616812be9141483fe37/users/1509da9e4a5742c48e83819e36e18839/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:16.814096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cc9090ecaa4616812be9141483fe37, user_id=1509da9e4a5742c48e83819e36e18839, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:16.818827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:16.897373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 961/1931] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:16 2022] PUT /identity/v3/projects/a1cc9090ecaa4616812be9141483fe37/users/1509da9e4a5742c48e83819e36e18839/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:16.898728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:16.911853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b781423-2c67-4440-957d-7a212c0eb21e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:17.007299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:17.009708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:17.082394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:17.083138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.083348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.083591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.084276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:17.103434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:17.120510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 971/1932] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:17.127410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:17.143585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90931264-5597-4ed3-8353-548e52ca3ce1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:17.150683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:17.151650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.152320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.153165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] PATH_INFO: `/v3/projects/a1cc9090ecaa4616812be9141483fe37/users/1509da9e4a5742c48e83819e36e18839/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.155563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1cc9090ecaa4616812be9141483fe37, user_id=1509da9e4a5742c48e83819e36e18839, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:17.158225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5022-1b47-4e96-83cc-cebacc8e3e80 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:17.160920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b041b-45ae-4fb2-8b97-016bdeaa7dfe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:17.165632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:17.166289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.166566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.166841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] PATH_INFO: `/v3/projects/b950fc8d0f0d46bd848f1a68749f41b2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.168320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b950fc8d0f0d46bd848f1a68749f41b2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:17.170491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:17.188724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 972/1933] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:17 2022] PUT /identity/v3/projects/a1cc9090ecaa4616812be9141483fe37/users/1509da9e4a5742c48e83819e36e18839/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:17.216245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.223176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.223176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.281889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] MFA Rules not processed for user `1509da9e4a5742c48e83819e36e18839`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:17.283408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:17.369455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b950fc8d0f0d46bd848f1a68749f41b2', 'request_id': 'req-6e071ea5-e8e5-4992-8e7f-54b6c6481608'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:17.371773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 973/1934] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:17.388446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b950fc8d0f0d46bd848f1a68749f41b2', 'request_id': 'req-6e071ea5-e8e5-4992-8e7f-54b6c6481608'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:17.500473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b950fc8d0f0d46bd848f1a68749f41b2', 'request_id': 'req-6e071ea5-e8e5-4992-8e7f-54b6c6481608'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:17.501038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:17.527272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] The token cache is being invalidate because project b950fc8d0f0d46bd848f1a68749f41b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:17.527564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:17.536450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:17.544971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 962/1935] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:17 2022] DELETE /identity/v3/projects/b950fc8d0f0d46bd848f1a68749f41b2 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:17.546416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:17.556134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:17.637078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d243b-d374-46d1-b1ec-e520897cd0f4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:17.729711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:17.730358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.730637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.730993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] PATH_INFO: `/v3/users/8182fc185f5f4890aef5752b204c0551` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.732280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8182fc185f5f4890aef5752b204c0551)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:17.734463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:17.763693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:17.766366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:17.834364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e071ea5-e8e5-4992-8e7f-54b6c6481608 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:17.838371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:17.839180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:17.839499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:17.839745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:17.841858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:17.935252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:17.938903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:17.965394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 963/1936] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:17.981426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8182fc185f5f4890aef5752b204c0551'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.057700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8182fc185f5f4890aef5752b204c0551'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.058927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8182fc185f5f4890aef5752b204c0551'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.059600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8182fc185f5f4890aef5752b204c0551'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.076550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8182fc185f5f4890aef5752b204c0551'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.098774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 974/1937] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:17 2022] DELETE /identity/v3/users/8182fc185f5f4890aef5752b204c0551 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:18.693016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:18.694957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:18.717891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f9f6f-482f-44b8-818c-62e9636b70e4 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:18.752749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:18.754784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:18.794826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:18.795676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:18.796701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:18.796983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] PATH_INFO: `/v3/projects/d2aaaaf04a7540a39862f03bb23a812d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:18.798248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aaaaf04a7540a39862f03bb23a812d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:18.800300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:18.832198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921ded-ae81-4a9f-af46-2e99176db33b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:18.837678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:18.838475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:18.838930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:18.839900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] PATH_INFO: `/v3/users/7ba00d9286d14fa285134bf71980be1c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:18.841525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba00d9286d14fa285134bf71980be1c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:18.843646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:18.923180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aaaaf04a7540a39862f03bb23a812d', 'request_id': 'req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:18.929188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aaaaf04a7540a39862f03bb23a812d', 'request_id': 'req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.035757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aaaaf04a7540a39862f03bb23a812d', 'request_id': 'req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.048206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] The token cache is being invalidate because project d2aaaaf04a7540a39862f03bb23a812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:19.048497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.049193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-a14bf8f9-1ef7-47bd-94b3-3559e1d085d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.050817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 964/1938] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:18 2022] DELETE /identity/v3/projects/d2aaaaf04a7540a39862f03bb23a812d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:19.056283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded0cd-316d-466e-8500-98219139b3d1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.056614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded0cd-316d-466e-8500-98219139b3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.056887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ded0cd-316d-466e-8500-98219139b3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.077248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba00d9286d14fa285134bf71980be1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.079646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-05ded0cd-316d-466e-8500-98219139b3d1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:19.080909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-05ded0cd-316d-466e-8500-98219139b3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.143267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 965/1939] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:19.154305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.154305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.154305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.173826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:19.175165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.183799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 966/1940] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:19.187960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.190452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba00d9286d14fa285134bf71980be1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.192695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:19.198984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba00d9286d14fa285134bf71980be1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.198984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba00d9286d14fa285134bf71980be1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.199618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9820-12f9-4071-b78e-098b71776bb0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.202659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba00d9286d14fa285134bf71980be1c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:19.203651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.204379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.204727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.205125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.205980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:19.206429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.208162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833adda2-f9d4-4256-8fdd-79b317419814 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.222224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 967/1941] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:19.227862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 975/1942] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:18 2022] DELETE /identity/v3/users/7ba00d9286d14fa285134bf71980be1c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:19.230971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.231360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.231617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.231897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.232879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.252426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:19.253644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.276500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:19.301010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf99902-6011-4031-87b3-3ecc789d4cfe admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.305932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.306597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.306884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.307163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.307987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.309948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.315830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 968/1943] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:19.325822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.327284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.384170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd6bbf-2d30-450e-a86a-d8992cf9c86c None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.387697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.388375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.388655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.388951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.400602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 976/1944] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:19.401600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.401872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.403307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.413234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 969/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:19.471087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdf44e-4553-4bdc-b423-4f548a0e24c0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.476421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.476825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.477106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.478045 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.478666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.480649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.582524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 977/1946] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:19.586627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.599362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a30ba-fa9c-43ba-a32d-4a1da93a86ee service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.605234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.606086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.606594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.607207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.608132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.609972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.624410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 970/1947] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:19.630046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.651360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf47c72-4c72-45ab-a427-79ee9d902799 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.659682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.660544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.660833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.661137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.661758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.663845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c8105-26d6-4c97-9a23-f5700c9dda9f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.680414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 978/1948] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:19.684365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.697871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02252b4-f241-4099-adf1-238a0aaf27f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.703475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.704414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.708848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.708848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] PATH_INFO: `/v3/projects/9062ce5bea9140cc98ac1a5385827894/users/e48a02f9f3d14ab0a8d064bacabcd50f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.721538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9062ce5bea9140cc98ac1a5385827894, user_id=e48a02f9f3d14ab0a8d064bacabcd50f, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.724655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.814345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 971/1949] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:19 2022] PUT /identity/v3/projects/9062ce5bea9140cc98ac1a5385827894/users/e48a02f9f3d14ab0a8d064bacabcd50f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:19.825700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.826185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.826290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.844299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.846068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.873105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] MFA Rules not processed for user `e48a02f9f3d14ab0a8d064bacabcd50f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:19.874619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:19.916947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c95a5-5e01-4d81-a81c-dd3266b087dc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:19.924308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:19.925150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:19.925599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:19.926034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] PATH_INFO: `/v3/projects/cfa56374a867420eaf7b4ef332d17671` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:19.927636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfa56374a867420eaf7b4ef332d17671)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:19.936428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:19.956490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 979/1950] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:19.970760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:19.972812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:20.067075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfa56374a867420eaf7b4ef332d17671', 'request_id': 'req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.077989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfa56374a867420eaf7b4ef332d17671', 'request_id': 'req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.081551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e955c-d495-4b99-a3f8-62a4b2f6a4c7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:20.135747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:20.136407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:20.136694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:20.136967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:20.151431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfa56374a867420eaf7b4ef332d17671', 'request_id': 'req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.163232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] The token cache is being invalidate because project cfa56374a867420eaf7b4ef332d17671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:20.163458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.164144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.166451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 972/1951] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:19 2022] DELETE /identity/v3/projects/cfa56374a867420eaf7b4ef332d17671 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:20.170517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:20.171840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:20.195886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:20.197529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:20.206756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 980/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:20.238914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dc56b-c6d2-4762-9dc4-b0693e02cbfb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:20.243642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:20.244374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:20.244675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:20.244927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] PATH_INFO: `/v3/users/1509da9e4a5742c48e83819e36e18839` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:20.246082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1509da9e4a5742c48e83819e36e18839)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:20.248128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:20.396190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1509da9e4a5742c48e83819e36e18839'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.470071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1509da9e4a5742c48e83819e36e18839'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.471161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1509da9e4a5742c48e83819e36e18839'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.472044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1509da9e4a5742c48e83819e36e18839'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.483214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1509da9e4a5742c48e83819e36e18839'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:20.510425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 973/1953] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:20 2022] DELETE /identity/v3/users/1509da9e4a5742c48e83819e36e18839 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:20.854124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:20.928930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:20.979653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.000110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9008-019e-4e7d-99d3-9e08b8c79885 service glance] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.109485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.110212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.110618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.110963 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] PATH_INFO: `/v3/projects/a1cc9090ecaa4616812be9141483fe37` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.112356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1cc9090ecaa4616812be9141483fe37)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.114661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.252525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1cc9090ecaa4616812be9141483fe37', 'request_id': 'req-c8bb5a75-12f4-40ad-9f12-45644d440dd0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.277940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.279466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:21.302704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28d844-e868-489a-8cce-489ab5ac0110 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.372290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.373016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.373298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.373575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] PATH_INFO: `/v3/users/e64a0bfd967743f0be36ba1ed67ff59e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.374402 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1cc9090ecaa4616812be9141483fe37', 'request_id': 'req-c8bb5a75-12f4-40ad-9f12-45644d440dd0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.374937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64a0bfd967743f0be36ba1ed67ff59e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.376983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.383173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1cc9090ecaa4616812be9141483fe37', 'request_id': 'req-c8bb5a75-12f4-40ad-9f12-45644d440dd0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.398882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] The token cache is being invalidate because project a1cc9090ecaa4616812be9141483fe37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:21.400286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.402846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c8bb5a75-12f4-40ad-9f12-45644d440dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.405284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 981/1954] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:20 2022] DELETE /identity/v3/projects/a1cc9090ecaa4616812be9141483fe37 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:21.411075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2fab-6c39-46a5-8061-1562d1db61eb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.411580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2fab-6c39-46a5-8061-1562d1db61eb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.411987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b2fab-6c39-46a5-8061-1562d1db61eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.434253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-db2b2fab-6c39-46a5-8061-1562d1db61eb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:21.434383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-db2b2fab-6c39-46a5-8061-1562d1db61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:21.443383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 982/1955] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:21.452105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.452401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.452796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.475979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:21.477241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:21.485437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 983/1956] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:21.489851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.499508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a745f92-c7d9-4d0e-8c04-e4670321c075 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.504527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.505131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.505415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.505708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.506506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:21.507033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.509465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.524124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 984/1957] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:21.527034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.538080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff355880-880f-438f-a07d-123290cc5812 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.543885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.544528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.544815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.545088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.545795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.548691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.611848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64a0bfd967743f0be36ba1ed67ff59e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.670361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 985/1958] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:21 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:21.674049 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.699535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64a0bfd967743f0be36ba1ed67ff59e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.700207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64a0bfd967743f0be36ba1ed67ff59e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.701114 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64a0bfd967743f0be36ba1ed67ff59e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.711109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-4f600f9f-e919-46fa-a843-a84b7e7c8c3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64a0bfd967743f0be36ba1ed67ff59e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:21.735096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 974/1959] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:21 2022] DELETE /identity/v3/users/e64a0bfd967743f0be36ba1ed67ff59e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:21.739725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.740212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.740656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.750590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145f9a3-fce1-4251-9522-88cf422f4574 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.762782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:21.764444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:21.839435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.839435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.839435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.839435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.986173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.986173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.987307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 975/1960] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:21.987307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:21.987307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:21.987307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd260b-5ac4-4429-9f67-223580572bd3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:21.988223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:21.988223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:21.988223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:21.988223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:21.988800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:21.988800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:21.988800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 976/1961] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:22.051344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 986/1962] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:21 2022] POST /identity/v3/users => generated 293 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:22.055491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.057771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:22.072406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba28b5-944a-41bc-9e7d-7a5483879df2 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.077599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.078204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.078486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.078758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.079400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.081091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:22.091339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 977/1963] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:22.095383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.106063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f9470-abb7-47d4-ac81-97a13b802566 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.111803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:22.112676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.113363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.113644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.113922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.114579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.116386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1056de6-cee8-401f-b9da-86aea7e3dcf3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:22.128329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 987/1964] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:22.132423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.142615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7f64d-02c1-470b-8564-595c1829d34b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.148201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.152156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.152156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.152156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] PATH_INFO: `/v3/projects/66a016783d4f4f5fa12c28ce1d375678/users/980ee7e2dece483081c0c3c5048fb33b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.153385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:22.168062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66a016783d4f4f5fa12c28ce1d375678, user_id=980ee7e2dece483081c0c3c5048fb33b, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.170827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:22.281448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 978/1965] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:22 2022] PUT /identity/v3/projects/66a016783d4f4f5fa12c28ce1d375678/users/980ee7e2dece483081c0c3c5048fb33b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:22.293215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.293506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.293786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.329853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] MFA Rules not processed for user `980ee7e2dece483081c0c3c5048fb33b`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:22.330448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:22.408100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.416058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:22.416313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 988/1966] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:22.425062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.426515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:22.503669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5488b-1c86-4e6a-80ce-ca9c1b1dc4f6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.505857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228158cd-928e-4d94-bf0b-d02b18653cc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.507816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.508689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.509079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.509472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.511669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.513106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.516231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.516231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] PATH_INFO: `/v3/projects/e3d7c22b964d4f18983f4953e60ee164` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.516231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d7c22b964d4f18983f4953e60ee164)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.518819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:22.524954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.526525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:22.538837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 989/1967] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:22.686619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d7c22b964d4f18983f4953e60ee164', 'request_id': 'req-772a0427-e50f-4bd5-b7ee-d826320e0312'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:22.692592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d7c22b964d4f18983f4953e60ee164', 'request_id': 'req-772a0427-e50f-4bd5-b7ee-d826320e0312'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:22.823878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d7c22b964d4f18983f4953e60ee164', 'request_id': 'req-772a0427-e50f-4bd5-b7ee-d826320e0312'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:22.835487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] The token cache is being invalidate because project e3d7c22b964d4f18983f4953e60ee164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:22.835785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:22.836499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:22.838694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 979/1968] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:22 2022] DELETE /identity/v3/projects/e3d7c22b964d4f18983f4953e60ee164 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:22.842787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:22.853887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99572e-3c24-43c6-9ca0-7c487d4f26f3 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:22.920344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:22.920344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:22.920344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:22.920344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] PATH_INFO: `/v3/users/bb7d6426ffad4f41b59caf878f774645` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:22.921099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7d6426ffad4f41b59caf878f774645)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:22.923226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:23.218673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7d6426ffad4f41b59caf878f774645'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:23.303546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7d6426ffad4f41b59caf878f774645'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:23.304236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7d6426ffad4f41b59caf878f774645'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:23.304864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7d6426ffad4f41b59caf878f774645'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:23.313197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7d6426ffad4f41b59caf878f774645'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:23.338784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 990/1969] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:22 2022] DELETE /identity/v3/users/bb7d6426ffad4f41b59caf878f774645 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:23.728952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:23.768522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:23.867301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:23.868797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:23.882534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0427-e50f-4bd5-b7ee-d826320e0312 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:23.958433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:23.959163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:23.959445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:23.959718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] PATH_INFO: `/v3/projects/17d74ef57c1148d8a50fd77a10e5d121` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:23.964898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d74ef57c1148d8a50fd77a10e5d121)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:23.970531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:24.094658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d74ef57c1148d8a50fd77a10e5d121', 'request_id': 'req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.100993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d74ef57c1148d8a50fd77a10e5d121', 'request_id': 'req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.183556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d74ef57c1148d8a50fd77a10e5d121', 'request_id': 'req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.199965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] The token cache is being invalidate because project 17d74ef57c1148d8a50fd77a10e5d121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:24.199965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.199965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.200563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 980/1970] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:23 2022] DELETE /identity/v3/projects/17d74ef57c1148d8a50fd77a10e5d121 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:24.205375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:24.207448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:24.225515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5d5d-f290-4b79-8be1-1c85a9a29d58 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:24.303012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:24.303775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:24.304128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:24.304501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] PATH_INFO: `/v3/users/4197fc761bac43b8b06b36892bfe6339` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:24.305744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4197fc761bac43b8b06b36892bfe6339)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:24.308255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:24.508011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4197fc761bac43b8b06b36892bfe6339'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.602441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4197fc761bac43b8b06b36892bfe6339'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.603243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4197fc761bac43b8b06b36892bfe6339'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.604053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4197fc761bac43b8b06b36892bfe6339'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.611564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-af747388-e7c7-4882-aa42-62ef957fb164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4197fc761bac43b8b06b36892bfe6339'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:24.629776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 991/1971] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:24 2022] DELETE /identity/v3/users/4197fc761bac43b8b06b36892bfe6339 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:24.927135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:25.052143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.053696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:25.067297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc4a78a-8ea6-4acb-a1f2-df09b8c831ff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.139523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.140138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.140416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.140689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] PATH_INFO: `/v3/projects/5236d794a725441aa4a858839f41a8e5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.141905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5236d794a725441aa4a858839f41a8e5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.144139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.272078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5236d794a725441aa4a858839f41a8e5', 'request_id': 'req-8f23483d-97b2-458d-a42d-914e6e3a61b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.278757 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5236d794a725441aa4a858839f41a8e5', 'request_id': 'req-8f23483d-97b2-458d-a42d-914e6e3a61b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.317374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:25.371991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5236d794a725441aa4a858839f41a8e5', 'request_id': 'req-8f23483d-97b2-458d-a42d-914e6e3a61b3'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.384445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] The token cache is being invalidate because project 5236d794a725441aa4a858839f41a8e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:25.384825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.385572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8f23483d-97b2-458d-a42d-914e6e3a61b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.387489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 981/1972] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:25 2022] DELETE /identity/v3/projects/5236d794a725441aa4a858839f41a8e5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:25.393260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.396210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.396493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.417096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:25.418461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:25.481945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 992/1973] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:25.493793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.494168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.495828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.514188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:25.515406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:25.523295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 982/1974] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:25.528205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.542370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f35b1-39e8-4c4b-ae53-6503624029b8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.547228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.547882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.548196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.548473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.549133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:25.549444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.551057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.563691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 993/1975] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:25.569876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.581283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143d28f-9556-4f19-9bf7-861f8dedb92a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.585896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.586544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.586821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.587092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.587733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.590077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.590219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:25.695126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 983/1976] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:25 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:25.699394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.713948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e240cd-a7f4-451a-95ac-99052f2ff488 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.779628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.779628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.780880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.780880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.781152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.783168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.792872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.796502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:25.811112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca435d7-0a22-49c4-9a90-00d9fdc092a9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.816826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.817548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.817851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.818133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] PATH_INFO: `/v3/users/980ee7e2dece483081c0c3c5048fb33b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.819228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=980ee7e2dece483081c0c3c5048fb33b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.821192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.872616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 994/1977] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:25 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:25.877238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.889668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26fb50-abe3-4bf7-88b0-22c3fb68a8b7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.900416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.905041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.905041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.905041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.905041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.905041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.916946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 995/1978] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:25.921112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.933317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a2759-aa19-4dd0-bcee-c14e0a03362c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.938104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.938713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.938993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.939258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.939906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.942476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:25.953541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 996/1979] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:25.957504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:25.968254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809094d-8acc-44af-9bfd-4e321871a51d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:25.973381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:25.974109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:25.974675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:25.975070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] PATH_INFO: `/v3/projects/88a4c25cec16431bb385b961c912bff5/users/4083898d1d8a47cd8e6e9b9324ec563f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:25.983435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '980ee7e2dece483081c0c3c5048fb33b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:25.993995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a4c25cec16431bb385b961c912bff5, user_id=4083898d1d8a47cd8e6e9b9324ec563f, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:25.996750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75bada0-135e-4f82-87cc-6dc5e07c0332 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.055575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '980ee7e2dece483081c0c3c5048fb33b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:26.056431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '980ee7e2dece483081c0c3c5048fb33b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:26.057385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '980ee7e2dece483081c0c3c5048fb33b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:26.063252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 997/1980] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:25 2022] PUT /identity/v3/projects/88a4c25cec16431bb385b961c912bff5/users/4083898d1d8a47cd8e6e9b9324ec563f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:26.065862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-64cbf8a7-994c-41a3-bf30-55009fb57bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '980ee7e2dece483081c0c3c5048fb33b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:26.078952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.079226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.079506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.088130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 984/1981] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:25 2022] DELETE /identity/v3/users/980ee7e2dece483081c0c3c5048fb33b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:26.092465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.092826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.093166 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.118445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:26.119688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:26.124384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] MFA Rules not processed for user `4083898d1d8a47cd8e6e9b9324ec563f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:26.125714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:26.188966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 985/1982] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:26.199612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.203345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:26.212689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 998/1983] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:26.213531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.215225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:26.232634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f55fa-afbe-4da6-a35d-5f972495ef7e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.239964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.240799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.241089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.241357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.242001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.244020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.272326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb06a6-b592-443e-9bce-df25f2395fd6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.276739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.277387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.277670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.277951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.292089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.293703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.304040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 986/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:26.336038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:26.346602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 999/1985] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:26 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:26.347930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.357775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69628473-b279-449c-b832-7b09b1e9dd5d service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.420918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.421620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.422169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.422634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.423277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.425300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.431173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:26.551560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 987/1986] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:26 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:26.552901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.567333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843c008-2c56-4f2c-9ca8-4ede6631d31c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.582639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.584229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.587317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.587607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.588326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.590134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.602371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1000/1987] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:26.607098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.637672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b81699-a121-4393-8757-46073265cea4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.643892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.646051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.646051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.646051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] PATH_INFO: `/v3/projects/90e78a5ea3c14fc987f0f776a00170d0/users/b69684e24c074a90bb5dd8a087e54830/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.664402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e78a5ea3c14fc987f0f776a00170d0, user_id=b69684e24c074a90bb5dd8a087e54830, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.672099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.806962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 988/1988] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:26 2022] PUT /identity/v3/projects/90e78a5ea3c14fc987f0f776a00170d0/users/b69684e24c074a90bb5dd8a087e54830/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:26.809034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.820739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a1c37-b952-4130-8b78-3eec8bdf5ff6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.911260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.912004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.912814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.913224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.913825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.916107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd01d-cc8f-412c-a91e-a12f377c00ff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.927386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1001/1989] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:26.932423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.948577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4008f464-e458-4ff2-9fbb-50e9c4c2b97f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:26.950825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:26.951502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.951779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.952372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] PATH_INFO: `/v3/projects/90e78a5ea3c14fc987f0f776a00170d0/users/b69684e24c074a90bb5dd8a087e54830/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.954499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e78a5ea3c14fc987f0f776a00170d0, user_id=b69684e24c074a90bb5dd8a087e54830, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:26.957338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:26.969927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 989/1990] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:26 2022] PUT /identity/v3/projects/90e78a5ea3c14fc987f0f776a00170d0/users/b69684e24c074a90bb5dd8a087e54830/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:26.980928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:26.981228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:26.981334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:26.981855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:26.983589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.053905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] MFA Rules not processed for user `b69684e24c074a90bb5dd8a087e54830`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:27.055780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.090823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e12d2d-f0c8-4525-a732-5bec92cbb116 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.096221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.096932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.097217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.097557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] PATH_INFO: `/v3/projects/66a016783d4f4f5fa12c28ce1d375678` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.098737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66a016783d4f4f5fa12c28ce1d375678)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.101205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:27.182809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1002/1991] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:27.194460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:27.197344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.236115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66a016783d4f4f5fa12c28ce1d375678', 'request_id': 'req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:27.251474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66a016783d4f4f5fa12c28ce1d375678', 'request_id': 'req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:27.296375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62953c-996e-413e-9826-eff93b468e60 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.339746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66a016783d4f4f5fa12c28ce1d375678', 'request_id': 'req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:27.353362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] The token cache is being invalidate because project 66a016783d4f4f5fa12c28ce1d375678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:27.353684 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:27.354311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7846dbc3-de66-4ed2-a688-e5bfdd0cbe36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:27.355202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.355839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.356263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.356602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 990/1992] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:26 2022] DELETE /identity/v3/projects/66a016783d4f4f5fa12c28ce1d375678 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:27.357330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.360298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.362121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.362597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.363097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.391089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:27.392508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.484032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.486628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31e09d-b27c-442e-a4f7-ed093119ac12 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:27.507654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:27.510882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1003/1993] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:27.524951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 991/1994] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:27.531765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451735b-7882-4a01-a351-afd24723baac None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.532573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451735b-7882-4a01-a351-afd24723baac None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.545073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451735b-7882-4a01-a351-afd24723baac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.556966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3451735b-7882-4a01-a351-afd24723baac None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:27.558212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3451735b-7882-4a01-a351-afd24723baac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.571312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1004/1995] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:27.572712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:27.595169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73f370f-d2a3-4ec6-978b-f46529d54500 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.610133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.610771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.611055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.611386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.612075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:27.612381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.623948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:27.631534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 992/1996] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:27.636931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451735b-7882-4a01-a351-afd24723baac None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:27.652034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451735b-7882-4a01-a351-afd24723baac None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.671798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.672464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.672872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.673070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.673696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.675866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:27.683906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:27.688224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.705614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ea09-bc5a-4c2c-8c22-88d59fd61ab4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.710246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.710850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.711130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.711939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.713947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:27.794835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.797080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:27.808858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 993/1997] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:27.813153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1005/1998] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:27 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:27.815551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:27.816672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:27.831582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd72ec-8fa8-4459-b2a9-5c3d49d276c9 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:27.889675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:27.904883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:27.905633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:27.906255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:27.906402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:27.907100 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:27.909199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.007441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 994/1999] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:27 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:28.012107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:28.022502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761527-6d33-4c9f-b5b3-6fa13f53308b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:28.027605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:28.033461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.033461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.033461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.033461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:28.036288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.056454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1006/2000] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:28.060500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:28.072831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccbcb-f052-4bb6-af49-b9471c37bfc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:28.077600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:28.078309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.078633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.078923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.079585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:28.082724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108365d4-d39c-46e2-93a7-0ccc02499491 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.100874 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 995/2001] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:28.101874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:28.113913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84219262-6640-449e-ab2b-07d1f59edaa8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:28.120174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:28.120842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.121175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.121392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] PATH_INFO: `/v3/projects/2b10d4b7b32e445581b025c3452d3597/users/975e68ff6df840f08e39f580480fecab/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.141569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b10d4b7b32e445581b025c3452d3597, user_id=975e68ff6df840f08e39f580480fecab, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:28.144659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.249732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1007/2002] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:28 2022] PUT /identity/v3/projects/2b10d4b7b32e445581b025c3452d3597/users/975e68ff6df840f08e39f580480fecab/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:28.264238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.264433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.264720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.295939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] MFA Rules not processed for user `975e68ff6df840f08e39f580480fecab`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:28.297298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:28.363604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 996/2003] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:28.456486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:28.458314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:28.521661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a8eb-85f9-4a53-a2b2-cf773c16a545 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:28.525255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:28.525967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.526259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.526564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.540258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:28.541682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac775b-e2c1-4e17-a528-7d75c65d4a97 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.554512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1008/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:28.582111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:28.674557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2aeb2-5650-40ba-9a26-f10a08e9411b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:28.682368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:28.682909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:28.683238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:28.683517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] PATH_INFO: `/v3/users/975e68ff6df840f08e39f580480fecab` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:28.684849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=975e68ff6df840f08e39f580480fecab)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:28.686957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:28.910342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '975e68ff6df840f08e39f580480fecab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:28.980247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '975e68ff6df840f08e39f580480fecab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:28.987401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:28.987934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '975e68ff6df840f08e39f580480fecab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:28.987934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '975e68ff6df840f08e39f580480fecab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:28.990681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '975e68ff6df840f08e39f580480fecab'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:29.009265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 997/2005] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:28 2022] DELETE /identity/v3/users/975e68ff6df840f08e39f580480fecab => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:29.013935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:29.014340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:29.014675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:29.035601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:29.036905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:29.066401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:29.104281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1009/2006] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:29.120206 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:29.121796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:29.184449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40c607-8b15-49b0-b066-fce00f0803a3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:29.189004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:29.189830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:29.190257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:29.190619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:29.201914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:29.203493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c4be-af73-4333-84d8-228fece20e95 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:29.216300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 998/2007] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:29.890104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:29.894298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:29.907568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3539-18a3-4c9d-9a54-a73f8ff6885e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:29.913278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:29.916310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:29.921533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:29.921533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] PATH_INFO: `/v3/projects/2b10d4b7b32e445581b025c3452d3597` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:29.921533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b10d4b7b32e445581b025c3452d3597)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:29.921533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:29.997338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:30.013290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb98e0-246d-4670-9a13-d9397055fd2f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:30.013673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb98e0-246d-4670-9a13-d9397055fd2f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:30.014149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb98e0-246d-4670-9a13-d9397055fd2f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:30.015737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 999/2008] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 14:01:30.043950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:30.044237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:30.044513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:30.076207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:30.077455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:30.083559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b10d4b7b32e445581b025c3452d3597', 'request_id': 'req-c2506c33-b694-4e63-81c2-52ec07e6b588'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.111422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:30.157804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1000/2009] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:30.162744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:30.164428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:30.172691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b10d4b7b32e445581b025c3452d3597', 'request_id': 'req-c2506c33-b694-4e63-81c2-52ec07e6b588'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.188597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b10d4b7b32e445581b025c3452d3597', 'request_id': 'req-c2506c33-b694-4e63-81c2-52ec07e6b588'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.212528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] The token cache is being invalidate because project 2b10d4b7b32e445581b025c3452d3597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:30.212949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.213840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.215658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1010/2010] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:29 2022] DELETE /identity/v3/projects/2b10d4b7b32e445581b025c3452d3597 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:30.217188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:30.219152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:30.253533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4656c-419d-4cbc-be82-919c678b734e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:30.253703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2506c33-b694-4e63-81c2-52ec07e6b588 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:30.264344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:30.265409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:30.265877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:30.266153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:30.268125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:30.275642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:30.276554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:30.276801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:30.277071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] PATH_INFO: `/v3/users/7b6d41c5989443b0954a147afd3b0417` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:30.278696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b6d41c5989443b0954a147afd3b0417)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:30.281707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:30.282159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:30.283422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:30.295543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1011/2011] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:30.474351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b6d41c5989443b0954a147afd3b0417'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.481287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:30.526014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b6d41c5989443b0954a147afd3b0417'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.526650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b6d41c5989443b0954a147afd3b0417'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.527276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b6d41c5989443b0954a147afd3b0417'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.534439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-c9d9bcf2-2a60-4f09-b994-99ba59c28bde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b6d41c5989443b0954a147afd3b0417'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:30.554087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1001/2012] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:30 2022] DELETE /identity/v3/users/7b6d41c5989443b0954a147afd3b0417 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:30.837103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:30.838546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:30.852726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a28c32-f86e-402a-9930-5d2f443ef1e1 service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:30.913528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:30.914157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:30.914442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:30.915225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] PATH_INFO: `/v3/projects/7f0f1dd8210f448691af52e760578493` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:30.916383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0f1dd8210f448691af52e760578493)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:30.918317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.049257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0f1dd8210f448691af52e760578493', 'request_id': 'req-240e9226-4966-416d-beee-0188dcbdd8b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.122616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0f1dd8210f448691af52e760578493', 'request_id': 'req-240e9226-4966-416d-beee-0188dcbdd8b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.128654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0f1dd8210f448691af52e760578493', 'request_id': 'req-240e9226-4966-416d-beee-0188dcbdd8b0'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.140879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] The token cache is being invalidate because project 7f0f1dd8210f448691af52e760578493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:31.146870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.146870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-240e9226-4966-416d-beee-0188dcbdd8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.146870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1012/2013] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:30 2022] DELETE /identity/v3/projects/7f0f1dd8210f448691af52e760578493 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:31.148354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.148645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.148994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.169215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:31.170463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.202078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:31.232508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1002/2014] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:31.235134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:31.240161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.244482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.244482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.260187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:31.261410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.272642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1013/2015] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:31.281550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.295432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2b99e-4d1f-411b-8ced-94292d569a83 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.296213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.297702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.300765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.301386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.301666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.301939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.302590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:31.302896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.304536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.315057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee36aed-75de-4df2-a9c0-cd1009f0c651 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.317069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.317712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.318009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.318254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1003/2016] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:31.318396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] PATH_INFO: `/v3/users/4083898d1d8a47cd8e6e9b9324ec563f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.319394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4083898d1d8a47cd8e6e9b9324ec563f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.321478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.325728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.335176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:31.340650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be099d3a-fc95-43b7-9ec0-30efd32cf283 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.345758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.346381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.346670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.346949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.347585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.349623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.454549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1004/2017] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:31.455744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.500581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:31.522667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d252cd7-aea8-4c6a-81f4-66b63ca87531 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.527888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.528521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.528804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.529070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.529719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.532063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.546558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4083898d1d8a47cd8e6e9b9324ec563f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.637047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4083898d1d8a47cd8e6e9b9324ec563f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.637676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4083898d1d8a47cd8e6e9b9324ec563f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.638389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4083898d1d8a47cd8e6e9b9324ec563f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.642885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1005/2018] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:31.646075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ea198a91-67d1-4e9c-8b75-0828afe3633d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4083898d1d8a47cd8e6e9b9324ec563f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:31.646984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.648685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.664287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9862c-6f74-4db1-95e3-3bbe8bd7690d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.668374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1014/2019] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:31 2022] DELETE /identity/v3/users/4083898d1d8a47cd8e6e9b9324ec563f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:31.669629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.670243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.670521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.670793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.672066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.672933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.673228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.673505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.673674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.684719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1006/2020] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:31.688772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.694804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:31.696287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.700064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952d9b-4cfb-4f41-af0f-5760a03d79bf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.761522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1015/2021] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:31.767116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.767884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.768266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.768641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.769320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.771582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.775385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.778101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:31.783993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1007/2022] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:31.792462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:31.809983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186cd4-84fa-4ccf-b90f-769c396ba245 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.809983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.809983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.809983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.810449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] PATH_INFO: `/v3/projects/d2c126e659e5481884c6849bba013764/users/f3601003a5ca4b40a4c25ff3c4b3f712/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.826950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c126e659e5481884c6849bba013764, user_id=f3601003a5ca4b40a4c25ff3c4b3f712, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.830027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.834889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:31.846928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b02807-6004-4e2b-bffc-191f8572333d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:31.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:31.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.858624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.861377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:31.862805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860682df-95bf-4cc8-b423-7da97ab912d9 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:31.872611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1016/2023] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:31.929737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1008/2024] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:31 2022] PUT /identity/v3/projects/d2c126e659e5481884c6849bba013764/users/f3601003a5ca4b40a4c25ff3c4b3f712/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:31.935230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:31.935589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:31.935968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:31.957570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:31.958734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:32.020473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1017/2025] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:32.030187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:32.031911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:32.049157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:32.096704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3045ad5-013c-4d70-8745-0bc088c2a224 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:32.100472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:32.101079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:32.101358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:32.101626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:32.112615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:32.114170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:32.124423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1009/2026] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:32.270089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:32.320364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:32.322033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:32.334034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9956df-f098-4faf-a9e0-5d3cfc8a61f5 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:32.339830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:32.340466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:32.341256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:32.341256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] PATH_INFO: `/v3/projects/88a4c25cec16431bb385b961c912bff5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:32.342501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a4c25cec16431bb385b961c912bff5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:32.344593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:32.516223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a4c25cec16431bb385b961c912bff5', 'request_id': 'req-c750723d-0050-47f1-8e31-04cb38d32a7c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:32.635745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a4c25cec16431bb385b961c912bff5', 'request_id': 'req-c750723d-0050-47f1-8e31-04cb38d32a7c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:32.642935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a4c25cec16431bb385b961c912bff5', 'request_id': 'req-c750723d-0050-47f1-8e31-04cb38d32a7c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:32.655639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] The token cache is being invalidate because project 88a4c25cec16431bb385b961c912bff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:32.655943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:32.656659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:32.658119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1018/2027] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:32 2022] DELETE /identity/v3/projects/88a4c25cec16431bb385b961c912bff5 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:32.662274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:32.673586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d5b8b-43d0-4484-b7ab-1f1a4f7b2b25 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:32.696514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:32.738678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:32.739344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:32.739628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:32.740204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] PATH_INFO: `/v3/users/b69684e24c074a90bb5dd8a087e54830` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:32.741107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b69684e24c074a90bb5dd8a087e54830)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:32.743158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:33.009128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b69684e24c074a90bb5dd8a087e54830'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.126459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b69684e24c074a90bb5dd8a087e54830'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.127152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b69684e24c074a90bb5dd8a087e54830'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.127786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b69684e24c074a90bb5dd8a087e54830'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.135724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b69684e24c074a90bb5dd8a087e54830'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.153164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1010/2028] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:32 2022] DELETE /identity/v3/users/b69684e24c074a90bb5dd8a087e54830 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:33.334243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:33.562569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:33.562569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:33.567766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:33.577065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:33.580046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:33.595651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750723d-0050-47f1-8e31-04cb38d32a7c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:33.672307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5f42-b825-4a37-82fb-dfabf6e2c7d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:33.677193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:33.678086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:33.678362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:33.678789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] PATH_INFO: `/v3/projects/90e78a5ea3c14fc987f0f776a00170d0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:33.680131 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e78a5ea3c14fc987f0f776a00170d0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:33.682243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:33.686787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:33.687451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:33.687737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:33.688243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] PATH_INFO: `/v3/users/622f2a032c19405895906f6f9df1ac0b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:33.690619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=622f2a032c19405895906f6f9df1ac0b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:33.697554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:33.925785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622f2a032c19405895906f6f9df1ac0b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.938794 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e78a5ea3c14fc987f0f776a00170d0', 'request_id': 'req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:33.951455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e78a5ea3c14fc987f0f776a00170d0', 'request_id': 'req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.015000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:34.015838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622f2a032c19405895906f6f9df1ac0b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.016702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622f2a032c19405895906f6f9df1ac0b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.017326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622f2a032c19405895906f6f9df1ac0b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.027626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3761e37b-78d4-49ad-a9ed-e9a52c92b97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622f2a032c19405895906f6f9df1ac0b'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.049271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1019/2029] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:33 2022] DELETE /identity/v3/users/622f2a032c19405895906f6f9df1ac0b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:34.053733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.054029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.054303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.074534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:34.075936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:34.092156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e78a5ea3c14fc987f0f776a00170d0', 'request_id': 'req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.108897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] The token cache is being invalidate because project 90e78a5ea3c14fc987f0f776a00170d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:34.109387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.110218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fcf84d44-e8be-4645-9be9-8806d8c2fc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:34.115946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1011/2030] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:33 2022] DELETE /identity/v3/projects/90e78a5ea3c14fc987f0f776a00170d0 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:34.117806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd36b-b446-45fe-a224-c94765b2264a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.118315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd36b-b446-45fe-a224-c94765b2264a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.118801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd36b-b446-45fe-a224-c94765b2264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.146921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a19dd36b-b446-45fe-a224-c94765b2264a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:34.148947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a19dd36b-b446-45fe-a224-c94765b2264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:34.174439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1020/2031] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:34.185140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.187040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:34.249788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1012/2032] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:34.257601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.257919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.258199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.265218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a69d8-9393-4ede-a1a1-e678a642b732 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.269218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.269978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.270272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.270540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.279418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:34.280578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:34.280689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.285450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.289250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1013/2033] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:34.293255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.297630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1021/2034] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:34.303524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8bdc-cfda-4f6d-afc2-703536a330c1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.309441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.310138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.310631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.310968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.311989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:34.315029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.315029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.332404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1014/2035] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:34.333619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.344971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f87d84-a3c3-4ef0-9f75-d2f604b4d15d service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.350346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.351274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.351624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.352039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.352765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.354872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.512424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1022/2036] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:34 2022] POST /identity/v3/projects => generated 407 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:34.517669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.534237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e3ba8-88ff-4559-85e0-9cf11f63e81e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.636826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.637448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.637788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.638071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.653078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.653078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.792478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1015/2037] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:34 2022] POST /identity/v3/users => generated 304 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:34.796712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.808070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a46b2-898f-4e07-8108-535d649eee88 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.812649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.813257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.813740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.814010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.814652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.816584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.826912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1023/2038] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:34.831145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.843188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.845904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:34.856330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db9f85-ac65-480d-8725-4a6674d835ea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.867760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d32b6b5-9307-4bdd-9ea4-d2a785044151 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.873404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.874708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.875281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.875554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] PATH_INFO: `/v3/projects/c4e619e6f338401ca852cd613d637a77` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.877046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e619e6f338401ca852cd613d637a77)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.878962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.879520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.880380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.880666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.880941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.881753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.883465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.897169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1016/2039] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:34.901412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:34.913870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6b86d-23de-4d75-bae4-1fc2825212b9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:34.919592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:34.920290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:34.920565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:34.920862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] PATH_INFO: `/v3/projects/dad9c8ec78ef4161a8d4da7a4ece2261/users/6c557ffebe9e4a79a82464faca71c679/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:34.936606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad9c8ec78ef4161a8d4da7a4ece2261, user_id=6c557ffebe9e4a79a82464faca71c679, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:34.939411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe2c3-691e-4e27-a42c-9ff6c04f00d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:34.956905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:35.033516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e619e6f338401ca852cd613d637a77', 'request_id': 'req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.041383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1017/2040] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:34 2022] PUT /identity/v3/projects/dad9c8ec78ef4161a8d4da7a4ece2261/users/6c557ffebe9e4a79a82464faca71c679/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:35.055735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.056215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.056640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.090110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] MFA Rules not processed for user `6c557ffebe9e4a79a82464faca71c679`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:35.091424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:35.092356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e619e6f338401ca852cd613d637a77', 'request_id': 'req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.102371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e619e6f338401ca852cd613d637a77', 'request_id': 'req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.119551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] The token cache is being invalidate because project c4e619e6f338401ca852cd613d637a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:35.120084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.120937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.122659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1024/2041] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:34 2022] DELETE /identity/v3/projects/c4e619e6f338401ca852cd613d637a77 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:35.126594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.128050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:35.178075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1018/2042] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:35 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:35.179435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.181107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:35.229219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86252660-fc4e-41cb-9b31-16dbb7ebd5e7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.275005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a788e-57e3-4f8f-b844-d54b99d0cd41 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.280302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.281199 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.281482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.281754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.282401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.284426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.310293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.310940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.311267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.315836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] PATH_INFO: `/v3/users/7c81636f603042c9bbbc2443460d0563` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.315836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c81636f603042c9bbbc2443460d0563)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.315836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.370528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1019/2043] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:35 2022] POST /identity/v3/projects => generated 409 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:35.374577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.451386 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb60c4-6e4d-407e-97e5-dea9b43766e8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.468359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.476148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.476148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.476148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.476148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.476148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.521301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c81636f603042c9bbbc2443460d0563'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.556601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1020/2044] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:35 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:35.560903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.572910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a8bd3-4619-46d3-801b-ca6f42f35353 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.579119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.579476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.580187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.580187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.581500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.582723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.599545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1021/2045] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:35.601010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.611611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f9a126-50bc-47d0-868f-24ad101217f3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.618091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.618528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.618805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.619084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] PATH_INFO: `/v3/projects/fbbea51f21174adf93b389a37f46695a/users/6a6ce1c29fff4847b36726930b980a01/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.637331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbea51f21174adf93b389a37f46695a, user_id=6a6ce1c29fff4847b36726930b980a01, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.641253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.641582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c81636f603042c9bbbc2443460d0563'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.643785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c81636f603042c9bbbc2443460d0563'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.645818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c81636f603042c9bbbc2443460d0563'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.656032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c81636f603042c9bbbc2443460d0563'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:35.688384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1025/2046] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:35 2022] DELETE /identity/v3/users/7c81636f603042c9bbbc2443460d0563 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:35.723232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1022/2047] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:35 2022] PUT /identity/v3/projects/fbbea51f21174adf93b389a37f46695a/users/6a6ce1c29fff4847b36726930b980a01/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:35.727229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.728859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:35.769442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:35.836651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a9fab-43a1-46a5-9858-5a4fc7992932 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.925959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.926584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.926919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.927174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.927821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.929647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7302040-0614-437e-95dd-bbe4b8d180cd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.949289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1026/2048] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:35.950411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:35.970279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320257-a6e9-44b0-9414-968b95dec2af admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:35.976598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:35.976598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:35.976598 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:35.976884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] PATH_INFO: `/v3/projects/fbbea51f21174adf93b389a37f46695a/users/6a6ce1c29fff4847b36726930b980a01/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:35.978722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbbea51f21174adf93b389a37f46695a, user_id=6a6ce1c29fff4847b36726930b980a01, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:35.982051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:35.994949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1023/2049] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:35 2022] PUT /identity/v3/projects/fbbea51f21174adf93b389a37f46695a/users/6a6ce1c29fff4847b36726930b980a01/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:36.006341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.006561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.006849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.046935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] MFA Rules not processed for user `6a6ce1c29fff4847b36726930b980a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:36.050040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.168403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1027/2050] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:36.179987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.182374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.246836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.260800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.264419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16dae36-8179-4be7-b482-5906a8460c78 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.268392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.269209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.269639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.270063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.280426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:36.282767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356e114-e6d1-4235-ab14-e0f64b357480 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:36.305153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1024/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:36.357267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f478a-fabd-4f82-867c-f8a6e0b3f251 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.367644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.367644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.367644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.367644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] PATH_INFO: `/v3/projects/4bb6bde855434776b38cd56c2bdfc243` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.368068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb6bde855434776b38cd56c2bdfc243)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:36.369841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:36.487623 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb6bde855434776b38cd56c2bdfc243', 'request_id': 'req-790b2ed7-b7ee-4b6f-a121-01547f493308'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:36.551141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb6bde855434776b38cd56c2bdfc243', 'request_id': 'req-790b2ed7-b7ee-4b6f-a121-01547f493308'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:36.558800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb6bde855434776b38cd56c2bdfc243', 'request_id': 'req-790b2ed7-b7ee-4b6f-a121-01547f493308'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:36.570644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] The token cache is being invalidate because project 4bb6bde855434776b38cd56c2bdfc243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:36.570920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:36.572231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-790b2ed7-b7ee-4b6f-a121-01547f493308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:36.573770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1028/2052] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:36 2022] DELETE /identity/v3/projects/4bb6bde855434776b38cd56c2bdfc243 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:36.579668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.581988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.582276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.609291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:36.610561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.673016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1025/2053] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:36.677418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:36.681959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.682512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.683012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.706829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:36.708615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.722181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1029/2054] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:36.729487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.739627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.744312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc0bd7-e77c-4979-99bf-a11f6a72e37d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.745713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.752229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.752861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.753449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.753449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.754072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:36.754753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:36.756294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:36.757231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:36.772779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1026/2055] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:36.777761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.787987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba0aa9-0725-4359-8541-05e8db928dce admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.793368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.793981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.794265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.794555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.795243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:36.797187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:36.825955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f60731-7a83-47e5-96af-d7913e0ff971 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.829678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.830802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.830802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.830802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.832689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:36.902778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:36.908734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:36.914018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1027/2056] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:36 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:36.918707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:36.924597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1030/2057] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:36.991591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c39b00d-88b1-485a-9226-d5f9a900ef45 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:36.997991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:36.998599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:36.999049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:36.999321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:36.999973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.002127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:37.175875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1028/2058] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:36 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:37.179848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:37.194240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e21193-9a0c-4f37-a488-fca53a434e15 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:37.199903 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:37.205365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.205365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.205365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.205365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.205365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:37.219485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1031/2059] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:37.220776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:37.234366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b414d0-c986-4d0a-b49c-4d3551e4a965 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:37.238929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:37.239559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.239841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.240160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.240885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.242502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e568ae9-e25f-4298-ad1b-5b004ced6cf4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:37.255955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1029/2060] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:37.258387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:37.268895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5740311-7796-460f-9d4a-7816f6a87e82 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:37.273610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:37.274849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.275162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.275441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] PATH_INFO: `/v3/projects/1aa5906efb4d4e7d907da81f5f5dbfe9/users/7d745d651b9742b49d270c4f3e1e6299/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.294583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa5906efb4d4e7d907da81f5f5dbfe9, user_id=7d745d651b9742b49d270c4f3e1e6299, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.298114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:37.376392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1032/2061] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:37 2022] PUT /identity/v3/projects/1aa5906efb4d4e7d907da81f5f5dbfe9/users/7d745d651b9742b49d270c4f3e1e6299/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:37.386907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.387198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.387476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.426798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] MFA Rules not processed for user `7d745d651b9742b49d270c4f3e1e6299`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:37.428975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:37.532182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1030/2062] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:37.536843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:37.603281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90478935-98b7-4365-93c8-786affc620ac admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:37.608618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:37.609243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.609527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.609805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.610513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.612476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c89b8-b32f-48fd-8078-a3557ab53aec admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:37.873816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1033/2063] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:37 2022] POST /identity/v3/projects => generated 367 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:37.877550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:37.891732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f1e99-893d-4a66-9a12-6618278e9b96 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:37.987596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:37.988405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:37.988695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:37.988971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:37.989619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:37.994600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.108996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f70b-2b24-4203-88c6-6cbc45d57c13 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.109545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f70b-2b24-4203-88c6-6cbc45d57c13 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.110103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924f70b-2b24-4203-88c6-6cbc45d57c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.112485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1031/2064] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:37 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:38.115882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.124226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:38.129058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eb0f8-afee-426d-8c31-a299bcffdb95 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.133487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.134643 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.134925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.135200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.135885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.138338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.150706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1032/2065] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:38.156940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.166144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a924f70b-2b24-4203-88c6-6cbc45d57c13 None None] MFA Rules not processed for user `f3601003a5ca4b40a4c25ff3c4b3f712`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:38.169235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a924f70b-2b24-4203-88c6-6cbc45d57c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:38.170495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7336c-dec0-44f4-97db-862538b9c2fb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.178167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.179101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.179551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.183116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] PATH_INFO: `/v3/projects/ee04db1f7aa24695afccea7a2f6a7060/users/8c378aef36ce4609aec20b53b3bc80c2/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.200778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee04db1f7aa24695afccea7a2f6a7060, user_id=8c378aef36ce4609aec20b53b3bc80c2, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.206949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.262765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1034/2066] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:38.264676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.264895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.265181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.287757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] MFA Rules not processed for user `f3601003a5ca4b40a4c25ff3c4b3f712`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:38.289399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:38.295966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1033/2067] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:38 2022] PUT /identity/v3/projects/ee04db1f7aa24695afccea7a2f6a7060/users/8c378aef36ce4609aec20b53b3bc80c2/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:38.298435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.355218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1035/2068] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:38.370525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.370714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b4d1e-31c5-4289-850c-f458958a9ea4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.372361 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:38.375872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.377015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.377302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.381766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.381766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.381766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.392937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1034/2069] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:38.397006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.407831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af656e3-a428-477b-bd7b-3bb8590dd877 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.412784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.413458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.413739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.414018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] PATH_INFO: `/v3/projects/ee04db1f7aa24695afccea7a2f6a7060/users/8c378aef36ce4609aec20b53b3bc80c2/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.416441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee04db1f7aa24695afccea7a2f6a7060, user_id=8c378aef36ce4609aec20b53b3bc80c2, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.419124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face1f3a-1a7f-47e6-a735-d7688e046333 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.432249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1035/2070] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:38 2022] PUT /identity/v3/projects/ee04db1f7aa24695afccea7a2f6a7060/users/8c378aef36ce4609aec20b53b3bc80c2/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:38.444167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.444326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.444910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.479158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] MFA Rules not processed for user `8c378aef36ce4609aec20b53b3bc80c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:38.480345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:38.487867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e989b57-c399-4aa0-ac35-e212bacc180b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.569528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.570486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.570924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.572024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.580982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1036/2071] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:38.588992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:38.649012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.651827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeec5ea-d151-4368-b771-8b6ce5b3ecaf service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.654407 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d803ea-7cb3-42d1-b20e-99e6c22ba092 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:38.658308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:38.658924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:38.659208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:38.659482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:38.666096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1036/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:38.668588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:38.673418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:38.675204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:38.688136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1037/2073] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:39.287111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:39.751887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20476fcf-b37f-4bd3-86e8-0df88e6ba45d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:39.752457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20476fcf-b37f-4bd3-86e8-0df88e6ba45d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:39.752782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20476fcf-b37f-4bd3-86e8-0df88e6ba45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:39.784984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-20476fcf-b37f-4bd3-86e8-0df88e6ba45d None None] MFA Rules not processed for user `f3601003a5ca4b40a4c25ff3c4b3f712`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:39.786313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-20476fcf-b37f-4bd3-86e8-0df88e6ba45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:39.804864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1037/2074] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:40.177578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:40.179146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:40.293688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fb6ab-5934-4df4-ba24-5133f92195c7 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:40.300543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:40.301609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:40.302126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:40.302614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] PATH_INFO: `/v3/users/e48a02f9f3d14ab0a8d064bacabcd50f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:40.304325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48a02f9f3d14ab0a8d064bacabcd50f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:40.307427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:40.417948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:40.537083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48a02f9f3d14ab0a8d064bacabcd50f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:40.608498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48a02f9f3d14ab0a8d064bacabcd50f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:40.609370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48a02f9f3d14ab0a8d064bacabcd50f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:40.610353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48a02f9f3d14ab0a8d064bacabcd50f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:40.623969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48a02f9f3d14ab0a8d064bacabcd50f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:40.647993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1038/2075] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:40 2022] DELETE /identity/v3/users/e48a02f9f3d14ab0a8d064bacabcd50f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:40.653247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:40.653551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:40.655315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:40.694549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:40.695907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:40.763763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1038/2076] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:40.773713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:40.775726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:40.841755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3699e-a52b-4621-b1bf-e00142695198 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:40.845943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:40.846602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:40.846946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:40.847344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:40.860554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:40.862319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce438a7-a50a-4a90-b7eb-318900d4db10 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:40.879302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1039/2077] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:41.349786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:41.518216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:41.525145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:41.539195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e55e6e-0021-428c-8a30-80d42835e054 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:41.547228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:41.556078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:41.571806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:41.572384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] PATH_INFO: `/v3/projects/9062ce5bea9140cc98ac1a5385827894` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:41.578664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9062ce5bea9140cc98ac1a5385827894)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:41.585133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:41.747664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9062ce5bea9140cc98ac1a5385827894', 'request_id': 'req-d397649f-c8b6-4541-9452-a38a46e333aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:41.853121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9062ce5bea9140cc98ac1a5385827894', 'request_id': 'req-d397649f-c8b6-4541-9452-a38a46e333aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:41.882706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9062ce5bea9140cc98ac1a5385827894', 'request_id': 'req-d397649f-c8b6-4541-9452-a38a46e333aa'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:41.902299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] The token cache is being invalidate because project 9062ce5bea9140cc98ac1a5385827894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:41.902787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:41.909730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d397649f-c8b6-4541-9452-a38a46e333aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:41.916541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1039/2078] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:41 2022] DELETE /identity/v3/projects/9062ce5bea9140cc98ac1a5385827894 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:41.918238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:41.918671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:41.918886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:41.963584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:41.963584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:42.073230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1040/2079] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:42.083408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.083986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.084548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.111298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:42.115509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:42.124851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1040/2080] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:42.129313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.153353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7d974-6cdd-4078-b7f4-8323a5534310 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.162987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.165631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.167580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.168216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.169263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:42.171343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.173242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.192301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1041/2081] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:42.196735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.212995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49749f4-1ce1-418a-ab00-d202a8cfebf6 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.223800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.224536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.224976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.225315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.226535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.229784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.292802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:42.326095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1041/2082] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:42 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:42.330578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.343810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f441-2e3c-4d85-bff8-42dcb1235623 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.418109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.418885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.419174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.419450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.420127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.422611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.548163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1042/2083] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:42 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:42.552807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.565911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989846a-0b8c-49bf-b6f3-e4e2096226e0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.571383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.572044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.572330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.572634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.573295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.574976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.588899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1042/2084] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:42.595190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.613860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba24abe-6ac8-4643-b867-3a6b72bead28 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.616740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.618936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:42.619472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.620132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.620416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.624654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.624654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.624654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.633826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79982c-321e-4ff5-afde-ae3bbc682f7a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.637478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1043/2085] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:42.641394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:42.645813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.646850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.647288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.647745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] PATH_INFO: `/v3/users/7d745d651b9742b49d270c4f3e1e6299` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.649635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d745d651b9742b49d270c4f3e1e6299)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.652004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.672239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b0bda2-dab0-4272-8c35-fa4d384e2fea admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:42.682477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:42.683349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.683732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.684154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] PATH_INFO: `/v3/projects/8b51157fe4d84baea424f6dacad8b261/users/2020ff631fd547d082cfc18f0d3f2383/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.700868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b51157fe4d84baea424f6dacad8b261, user_id=2020ff631fd547d082cfc18f0d3f2383, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:42.703585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd9bdb-5e67-4aca-b700-4062efb450b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:42.811956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1044/2086] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:42 2022] PUT /identity/v3/projects/8b51157fe4d84baea424f6dacad8b261/users/2020ff631fd547d082cfc18f0d3f2383/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:42.825160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:42.825412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:42.825691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:42.885663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] MFA Rules not processed for user `2020ff631fd547d082cfc18f0d3f2383`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:42.887081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:42.969857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d745d651b9742b49d270c4f3e1e6299'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:42.982829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:42.997879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1045/2087] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:43.003609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.065375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d745d651b9742b49d270c4f3e1e6299'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:43.066125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d745d651b9742b49d270c4f3e1e6299'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:43.067116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d745d651b9742b49d270c4f3e1e6299'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:43.092512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-15619388-3364-4cd9-ba35-15970e4816bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d745d651b9742b49d270c4f3e1e6299'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:43.092707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316284e-bff7-481b-a4e9-c20b20cecebf None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.095953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.096708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.097046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.097323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.097959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.100170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.128822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1043/2088] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:42 2022] DELETE /identity/v3/users/7d745d651b9742b49d270c4f3e1e6299 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:43.136649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.136946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.137064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.161147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:43.161147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:43.205746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1046/2089] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:43.209910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.214089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:43.228125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1044/2090] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:43.238035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.239401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:43.281035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c0981-e575-4b5c-a469-8378b2e32fb7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.288243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.288869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.289155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.289419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.290168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.292259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.301852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d719b-d31c-4bbd-8750-9eba841c5967 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.328734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:43.355328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.355986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.356274 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.356546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.365949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.367405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.377916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1045/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:43.427267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1047/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:43 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:43.428675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.439098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b3ec2-838a-4169-a605-1ceaae1c5250 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.444199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.444811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.445074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.448144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.448144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.448333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.458539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1046/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:43.467041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.481855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c3b32-164f-46aa-be13-f3d2a63311fa admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.486798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.487468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.487747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.488052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] PATH_INFO: `/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7/users/b58423a4d35d4c2ca59a4e6b951c5571/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.506204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ec3e97f6574d99bef9e9345d8786e7, user_id=b58423a4d35d4c2ca59a4e6b951c5571, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.509861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.603066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1048/2094] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:43 2022] PUT /identity/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7/users/b58423a4d35d4c2ca59a4e6b951c5571/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:43.607146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.617177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d97da-4f2b-474f-8e5c-a1efb899b073 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.675745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.676439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.676723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.676999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.677648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.679461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26feb3ab-b9bd-4f9e-92a2-c8eca2ffcc98 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.692077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1047/2095] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:43.695195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.705703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8b23c-d5bd-49e2-969f-7d3903b23e7d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.710461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.711106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.711384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.711686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] PATH_INFO: `/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7/users/b58423a4d35d4c2ca59a4e6b951c5571/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.713631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ec3e97f6574d99bef9e9345d8786e7, user_id=b58423a4d35d4c2ca59a4e6b951c5571, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:43.716462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:43.726800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1049/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:43 2022] PUT /identity/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7/users/b58423a4d35d4c2ca59a4e6b951c5571/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:43.737626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.738040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.738320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.767416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] MFA Rules not processed for user `b58423a4d35d4c2ca59a4e6b951c5571`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:43.768358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:43.855826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1048/2097] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:43.868743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:43.870923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:43.947884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d807868-f5cc-4833-941e-3fb99f444200 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:43.952509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:43.953359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:43.953876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:43.954271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:43.956895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:44.052895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:44.055190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:44.067658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1050/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:44.116519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:44.116519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:44.278231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9508c7-c384-4953-b1d2-7fd6ace97173 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:44.288622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:44.289377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:44.291133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:44.291432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] PATH_INFO: `/v3/projects/1aa5906efb4d4e7d907da81f5f5dbfe9` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:44.293803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa5906efb4d4e7d907da81f5f5dbfe9)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:44.298878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:44.429289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:44.507672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa5906efb4d4e7d907da81f5f5dbfe9', 'request_id': 'req-08fb529c-6203-450d-ac65-81cf532024f1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:44.589381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa5906efb4d4e7d907da81f5f5dbfe9', 'request_id': 'req-08fb529c-6203-450d-ac65-81cf532024f1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:44.597346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa5906efb4d4e7d907da81f5f5dbfe9', 'request_id': 'req-08fb529c-6203-450d-ac65-81cf532024f1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:44.610332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] The token cache is being invalidate because project 1aa5906efb4d4e7d907da81f5f5dbfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:44.610696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:44.611384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:44.613434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1049/2099] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:44 2022] DELETE /identity/v3/projects/1aa5906efb4d4e7d907da81f5f5dbfe9 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:44.617339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:44.629046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654ccf-4136-4f79-98d2-9c0f4aa39577 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:44.689061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:44.690791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:44.714460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:44.715423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:44.715775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:44.716178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] PATH_INFO: `/v3/users/8c378aef36ce4609aec20b53b3bc80c2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:44.717408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c378aef36ce4609aec20b53b3bc80c2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:44.719663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:44.791257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb529c-6203-450d-ac65-81cf532024f1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:44.798512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:44.801188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:44.801650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:44.802081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] PATH_INFO: `/v3/users/6c557ffebe9e4a79a82464faca71c679` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:44.803519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c557ffebe9e4a79a82464faca71c679)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:44.806240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:44.939814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:44.970937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c378aef36ce4609aec20b53b3bc80c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.044243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c557ffebe9e4a79a82464faca71c679'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.078277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c378aef36ce4609aec20b53b3bc80c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.079064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c378aef36ce4609aec20b53b3bc80c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.079894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c378aef36ce4609aec20b53b3bc80c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.098647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3e85c4c1-2829-4fa3-b121-06a64e840d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c378aef36ce4609aec20b53b3bc80c2'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.145792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1051/2100] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:44 2022] DELETE /identity/v3/users/8c378aef36ce4609aec20b53b3bc80c2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:45.154841 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c557ffebe9e4a79a82464faca71c679'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.155773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c557ffebe9e4a79a82464faca71c679'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.156458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c557ffebe9e4a79a82464faca71c679'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.165708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c557ffebe9e4a79a82464faca71c679'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:45.190773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1050/2101] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:44 2022] DELETE /identity/v3/users/6c557ffebe9e4a79a82464faca71c679 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:45.195249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:45.195545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:45.195826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:45.223318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:45.224823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:45.296349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1052/2102] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:45.307062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:45.309702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:45.392520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba90748-27c5-4214-b07d-ecea8a4b19b8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:45.402141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:45.406107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:45.407495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:45.407786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:45.422748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:45.424292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:45.442843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1051/2103] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:45.906583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:45.908047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:45.920134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1148b-1d3b-4e16-b037-bf21669ad4c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:45.925406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:45.926050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:45.926446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:45.926758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] PATH_INFO: `/v3/projects/ee04db1f7aa24695afccea7a2f6a7060` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:45.928263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee04db1f7aa24695afccea7a2f6a7060)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:45.930185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.102984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee04db1f7aa24695afccea7a2f6a7060', 'request_id': 'req-93bd0245-e947-4d74-a3aa-a053c0190756'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.117066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.117845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee04db1f7aa24695afccea7a2f6a7060', 'request_id': 'req-93bd0245-e947-4d74-a3aa-a053c0190756'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.118978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:46.148805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27b5a7-9873-40ec-888c-f7e90550e40e service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.200658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee04db1f7aa24695afccea7a2f6a7060', 'request_id': 'req-93bd0245-e947-4d74-a3aa-a053c0190756'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.213647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] The token cache is being invalidate because project ee04db1f7aa24695afccea7a2f6a7060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:46.213943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.214769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-93bd0245-e947-4d74-a3aa-a053c0190756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.216503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1053/2104] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:45 2022] DELETE /identity/v3/projects/ee04db1f7aa24695afccea7a2f6a7060 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:46.221217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19558-e586-4177-b2ce-868d4c494a3c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.221645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19558-e586-4177-b2ce-868d4c494a3c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.222153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19558-e586-4177-b2ce-868d4c494a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.233845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.234516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.234793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.235067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] PATH_INFO: `/v3/projects/dad9c8ec78ef4161a8d4da7a4ece2261` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.236238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad9c8ec78ef4161a8d4da7a4ece2261)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.238275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.243484 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-17e19558-e586-4177-b2ce-868d4c494a3c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:46.244759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-17e19558-e586-4177-b2ce-868d4c494a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:46.252951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1054/2105] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:46.261421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.261747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.262068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.282673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:46.283945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:46.292713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1055/2106] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:46.296729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.306760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d58d2-1212-4681-8309-8cbb83efd28d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.312295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.312919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.313207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.317356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.317356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:46.317356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.317356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.329373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1056/2107] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:46.333653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.343249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c36c7-cac6-4e72-a331-03727137ad23 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.347834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.352338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.352338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.352338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.352338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.352338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.395164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad9c8ec78ef4161a8d4da7a4ece2261', 'request_id': 'req-df884348-7dee-4ea8-9551-074414d2e42f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.494171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1057/2108] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:46 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:46.498612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.527813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad9c8ec78ef4161a8d4da7a4ece2261', 'request_id': 'req-df884348-7dee-4ea8-9551-074414d2e42f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.534827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad9c8ec78ef4161a8d4da7a4ece2261', 'request_id': 'req-df884348-7dee-4ea8-9551-074414d2e42f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.547135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] The token cache is being invalidate because project dad9c8ec78ef4161a8d4da7a4ece2261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:46.547453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.548250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.549782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1052/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:46 2022] DELETE /identity/v3/projects/dad9c8ec78ef4161a8d4da7a4ece2261 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:46.553830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.555244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:46.561002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bba597-5aa7-4f22-8b85-6f98b28f15e1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.565683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.566578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.566876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.567159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.567790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.569744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.620200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df884348-7dee-4ea8-9551-074414d2e42f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.624999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.625633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.625914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.626192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] PATH_INFO: `/v3/users/6a6ce1c29fff4847b36726930b980a01` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.627363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6ce1c29fff4847b36726930b980a01)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.629338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.699775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1058/2110] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:46 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:46.704099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.716339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:46.730120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58969a6-a758-4c2e-a2ab-3faf538d4f66 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.735590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.736242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.736520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.736788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.737462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.739283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.753818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1059/2111] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:46.754961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.766956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8bd2b-0f13-4fb9-b88d-a2ce12b598e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.772434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.773141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.774912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.774912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.775093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.776828 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.793716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1060/2112] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:46.794948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:46.807297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220974c-5a7b-4984-984e-2def8f494441 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:46.813652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:46.814553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.814995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.815795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] PATH_INFO: `/v3/projects/e8a4358605ce48ccac4edb7674264846/users/9241188e45d540ae9e14539bf0b907da/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.836493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a4358605ce48ccac4edb7674264846, user_id=9241188e45d540ae9e14539bf0b907da, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:46.840572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bce1e-85f6-4946-a74e-e256e83a7bb9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:46.867649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6ce1c29fff4847b36726930b980a01'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.923866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1061/2113] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:46 2022] PUT /identity/v3/projects/e8a4358605ce48ccac4edb7674264846/users/9241188e45d540ae9e14539bf0b907da/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:46.935735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:46.936050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:46.936572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:46.943156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6ce1c29fff4847b36726930b980a01'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.944121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6ce1c29fff4847b36726930b980a01'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.944994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6ce1c29fff4847b36726930b980a01'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.953824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6ce1c29fff4847b36726930b980a01'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:46.962707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:46.983145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1053/2114] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:46 2022] DELETE /identity/v3/users/6a6ce1c29fff4847b36726930b980a01 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:46.996269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] MFA Rules not processed for user `9241188e45d540ae9e14539bf0b907da`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:46.997942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:47.080410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1062/2115] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:47.084961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.087080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:47.163637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c6c8a-e7d0-4eb7-9bff-4c52b633013c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.168883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.169693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.170143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.170579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.171305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.173416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.220155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:47.294640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1054/2116] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:47 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:47.296409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.308449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d19f9e-dc36-4611-bd2c-c4cb7f35c7a8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.397270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.398002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.398357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.399043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.399419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.402175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.508292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1063/2117] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:47 2022] POST /identity/v3/users => generated 300 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:47.509867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.523466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559efa4-5d13-47c1-9cd1-b98cbbb635c7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.531768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.533675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:47.542691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.548475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.548475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.548475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.548475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.548475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.548979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b89a1-9082-4d3b-9917-ef4ef9a35c9e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.560499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1055/2118] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:47.560929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.561690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.561980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.562266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] PATH_INFO: `/v3/users/2020ff631fd547d082cfc18f0d3f2383` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.563530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2020ff631fd547d082cfc18f0d3f2383)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.565584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.565721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.576826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc4934d-5269-43db-9957-34d039a9ec3b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.583308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.584044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.584331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.584611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] PATH_INFO: `/v3/projects/7c021c5b1f4644cd9572aeca08c99576/users/df4e43b668ed403998d5d55c639e892a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.601228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c021c5b1f4644cd9572aeca08c99576, user_id=df4e43b668ed403998d5d55c639e892a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.604537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.700624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1056/2119] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:47 2022] PUT /identity/v3/projects/7c021c5b1f4644cd9572aeca08c99576/users/df4e43b668ed403998d5d55c639e892a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:47.704860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.766714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b433be0-ee50-49f8-b1ce-e87541287397 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.771497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.772142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.772429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.772704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.773341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.775563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.786470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1057/2120] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:47.791203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.796533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2020ff631fd547d082cfc18f0d3f2383'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:47.800960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c8942-32d3-4d5f-b08a-aa9a5e79871d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.805828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.806632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.806807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.807088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] PATH_INFO: `/v3/projects/7c021c5b1f4644cd9572aeca08c99576/users/df4e43b668ed403998d5d55c639e892a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.809115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c021c5b1f4644cd9572aeca08c99576, user_id=df4e43b668ed403998d5d55c639e892a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.815314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.824602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1058/2121] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:47 2022] PUT /identity/v3/projects/7c021c5b1f4644cd9572aeca08c99576/users/df4e43b668ed403998d5d55c639e892a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:47.825260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:47.827166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:47.863160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2020ff631fd547d082cfc18f0d3f2383'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:47.863839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2020ff631fd547d082cfc18f0d3f2383'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:47.864499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2020ff631fd547d082cfc18f0d3f2383'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:47.872295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90f1f526-9c2e-4e0a-a126-07f3121f6025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2020ff631fd547d082cfc18f0d3f2383'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:47.890503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1064/2122] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:47 2022] DELETE /identity/v3/users/2020ff631fd547d082cfc18f0d3f2383 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:47.891742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b13404-9709-45c0-981d-2ad9552d159e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.892093 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b13404-9709-45c0-981d-2ad9552d159e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.892842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b13404-9709-45c0-981d-2ad9552d159e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.896271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ad8b4-d2bc-47b1-bdbd-71fedbf781d2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:47.922128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-83b13404-9709-45c0-981d-2ad9552d159e None None] MFA Rules not processed for user `df4e43b668ed403998d5d55c639e892a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:47.923406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83b13404-9709-45c0-981d-2ad9552d159e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:47.956001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:47.956649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.956932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.957207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] PATH_INFO: `/v3/projects/fbbea51f21174adf93b389a37f46695a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:47.958347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbbea51f21174adf93b389a37f46695a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:47.960374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:47.995389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1065/2123] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:47.996675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:47.996958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:47.997228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.019158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:48.020369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.029020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1066/2124] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:48.029832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.034010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.084407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbbea51f21174adf93b389a37f46695a', 'request_id': 'req-167ef64e-1f3b-49a2-87da-cb1cf7def820'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.094867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0aab0-3ddb-4702-80ba-80442407895b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.147531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.148183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.148592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.148873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.156786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbbea51f21174adf93b389a37f46695a', 'request_id': 'req-167ef64e-1f3b-49a2-87da-cb1cf7def820'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.162807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbbea51f21174adf93b389a37f46695a', 'request_id': 'req-167ef64e-1f3b-49a2-87da-cb1cf7def820'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.173953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] The token cache is being invalidate because project fbbea51f21174adf93b389a37f46695a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:48.174245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.174900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.176433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1059/2125] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:47 2022] DELETE /identity/v3/projects/fbbea51f21174adf93b389a37f46695a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:48.177280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.184548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.215261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.216777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265e9f-65e9-4b3c-af62-8f1cb383fd3c service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.226560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1067/2126] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:48.227871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.228695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.229056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.238576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ef64e-1f3b-49a2-87da-cb1cf7def820 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.242468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.243084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.243366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.243661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.245571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.259011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:48.260323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.298716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:48.310706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.312194 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d7001-9f64-458c-a667-92e896d1f852 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.320343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1068/2127] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:48.321761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.323222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.323707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1060/2128] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:48.328746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d139-e567-4537-b1de-aa420752382c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.329043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d139-e567-4537-b1de-aa420752382c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.329327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5d139-e567-4537-b1de-aa420752382c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.336142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bfcf8-3ac6-4413-ba80-51e704589599 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.341699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.342234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.342514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.342786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] PATH_INFO: `/v3/users/9241188e45d540ae9e14539bf0b907da` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.343963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9241188e45d540ae9e14539bf0b907da)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.345902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.350973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-cab5d139-e567-4537-b1de-aa420752382c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:48.352820 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-cab5d139-e567-4537-b1de-aa420752382c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.361567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1061/2129] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:48.365939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d139-e567-4537-b1de-aa420752382c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.375832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5d139-e567-4537-b1de-aa420752382c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.380927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.381568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.381983 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.382261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.382911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:48.383215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.385384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.401886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1062/2130] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:48.402782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.408533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:48.412933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353e6d-71dd-440e-8e3e-3c0248eade76 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.417801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.418399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.418685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.419493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.420341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.421611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.537822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1063/2131] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:48 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:48.543666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.553474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9241188e45d540ae9e14539bf0b907da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.609897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e55df6-0c1b-4d43-b6ee-b298f7e97238 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.615002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.615710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.616101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.616471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.617176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.619684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.664960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9241188e45d540ae9e14539bf0b907da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.665756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9241188e45d540ae9e14539bf0b907da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.666489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9241188e45d540ae9e14539bf0b907da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.674348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-23475491-74e1-42c0-be8b-29f6a778a816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9241188e45d540ae9e14539bf0b907da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.692444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1069/2132] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:48 2022] DELETE /identity/v3/users/9241188e45d540ae9e14539bf0b907da => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:48.697344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.697630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.697907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.716714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:48.717900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.722508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1064/2133] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:48 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:48.731687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.733383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.748328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac50ee8-88b3-412c-912e-47d7dbeb637c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.784868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1070/2134] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:48.785693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.787028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.803573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93ce99-25d2-4a41-952f-564df117b7c3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.804269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.804914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.805193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.806104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] PATH_INFO: `/v3/projects/8b51157fe4d84baea424f6dacad8b261` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.807243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b51157fe4d84baea424f6dacad8b261)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.809215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.828598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.829269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.829545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.829818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.830457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.832127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.844745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1065/2135] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:48.844745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.844745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:48.900173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90a693-57c0-4459-b4fd-6d9ff7b84b82 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.903864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.904536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.904817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.905097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.914073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:48.916038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:48.925626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1066/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:48.926448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:48.936655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b05023-0b29-41d1-99af-61262678f76d service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:48.939801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b51157fe4d84baea424f6dacad8b261', 'request_id': 'req-2c0a51f3-0dad-4dad-9ec8-c56c37143680'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.946588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b51157fe4d84baea424f6dacad8b261', 'request_id': 'req-2c0a51f3-0dad-4dad-9ec8-c56c37143680'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:48.996828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:48.997472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:48.997818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:48.998090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:48.998730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.000371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.010655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1067/2137] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:49.014838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.023505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b51157fe4d84baea424f6dacad8b261', 'request_id': 'req-2c0a51f3-0dad-4dad-9ec8-c56c37143680'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.025471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458e093-11c1-4932-993d-2327bb24b20a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.030472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.031183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.031467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.031776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] PATH_INFO: `/v3/projects/c05efcde8c894071b41c44eafbbea1b7/users/a04cd7d550bf4a7fae53976f3957ffc9/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.036378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] The token cache is being invalidate because project 8b51157fe4d84baea424f6dacad8b261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:49.036675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.037342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.039225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1071/2138] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:48 2022] DELETE /identity/v3/projects/8b51157fe4d84baea424f6dacad8b261 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:49.043622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.046267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.047797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05efcde8c894071b41c44eafbbea1b7, user_id=a04cd7d550bf4a7fae53976f3957ffc9, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.051085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec64256-c136-4cb6-bf1f-588b7004dc4e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.063334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a51f3-0dad-4dad-9ec8-c56c37143680 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.063985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.064604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.064880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.065150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] PATH_INFO: `/v3/users/b58423a4d35d4c2ca59a4e6b951c5571` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.066615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58423a4d35d4c2ca59a4e6b951c5571)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.068723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.152528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1068/2139] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:49 2022] PUT /identity/v3/projects/c05efcde8c894071b41c44eafbbea1b7/users/a04cd7d550bf4a7fae53976f3957ffc9/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:49.164380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.165384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.165804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.198092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] MFA Rules not processed for user `a04cd7d550bf4a7fae53976f3957ffc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:49.200314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.254343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:49.262012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58423a4d35d4c2ca59a4e6b951c5571'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.271714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1069/2140] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:49.276691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.277998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.345770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7035c65f-2323-4a3b-9cd1-dfc353a7656a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.350686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.351305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.351589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.351861 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.353151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.355151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.362010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58423a4d35d4c2ca59a4e6b951c5571'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.362648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58423a4d35d4c2ca59a4e6b951c5571'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.363283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58423a4d35d4c2ca59a4e6b951c5571'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.370722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58423a4d35d4c2ca59a4e6b951c5571'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.388054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1072/2141] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:49 2022] DELETE /identity/v3/users/b58423a4d35d4c2ca59a4e6b951c5571 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:49.404563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.406069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.472130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1070/2142] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:49 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:49.473406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.478241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.484544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3cfb2-5001-4138-bf4c-4dc7bbbb96d2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.486960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:49.545939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da6bd8-db3b-427f-a9da-57f6392f28c8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.547312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.547976 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.548266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.548543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] PATH_INFO: `/v3/projects/e8a4358605ce48ccac4edb7674264846` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.550409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a4358605ce48ccac4edb7674264846)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.550812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.552224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.552358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.552556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.552825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.553455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.555409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.678611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1071/2143] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:49 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:49.679560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.689843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7568a42-a95b-4c1d-8e9d-a5d03ad4d22e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.699648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a4358605ce48ccac4edb7674264846', 'request_id': 'req-3bd02479-9280-4274-b027-237ddfabfce8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.706707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a4358605ce48ccac4edb7674264846', 'request_id': 'req-3bd02479-9280-4274-b027-237ddfabfce8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.749633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.750240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.750521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.750792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.751430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.753050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.763191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1072/2144] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:49.767122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.776900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cff8c-d283-4b20-9c1a-5f83822b9b11 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.782036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.783257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.783257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.783257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] PATH_INFO: `/v3/projects/819d929236ae435f9fe055d18cdf5e28/users/b1fe73f46be6428bb4a4f0b0d8464d4d/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.797253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=819d929236ae435f9fe055d18cdf5e28, user_id=b1fe73f46be6428bb4a4f0b0d8464d4d, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.799907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.802257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a4358605ce48ccac4edb7674264846', 'request_id': 'req-3bd02479-9280-4274-b027-237ddfabfce8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.813883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] The token cache is being invalidate because project e8a4358605ce48ccac4edb7674264846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:49.814178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.814851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:49.816727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1073/2145] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:49 2022] DELETE /identity/v3/projects/e8a4358605ce48ccac4edb7674264846 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:49.820488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.822317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.834929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd02479-9280-4274-b027-237ddfabfce8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.840896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.841534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.841818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.842094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] PATH_INFO: `/v3/users/df4e43b668ed403998d5d55c639e892a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.843248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4e43b668ed403998d5d55c639e892a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.845791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:49.893728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1073/2146] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:49 2022] PUT /identity/v3/projects/819d929236ae435f9fe055d18cdf5e28/users/b1fe73f46be6428bb4a4f0b0d8464d4d/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:49.894689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:49.896466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:49.960685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd9fa2-f7b3-4af0-96b8-3b9c79ba0faa admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:49.965984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:49.966614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:49.966897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:49.967174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] PATH_INFO: `/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:49.968324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ec3e97f6574d99bef9e9345d8786e7)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:49.970285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.054473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4e43b668ed403998d5d55c639e892a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.069210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:50.086011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ec3e97f6574d99bef9e9345d8786e7', 'request_id': 'req-e8b293db-c2c5-4d44-81ac-8ed0e3241405'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.120110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4e43b668ed403998d5d55c639e892a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.120737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4e43b668ed403998d5d55c639e892a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.121384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4e43b668ed403998d5d55c639e892a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.129135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4e43b668ed403998d5d55c639e892a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.147091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1074/2147] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:49 2022] DELETE /identity/v3/users/df4e43b668ed403998d5d55c639e892a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:50.151895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.153377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.209531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:50.210802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ec3e97f6574d99bef9e9345d8786e7', 'request_id': 'req-e8b293db-c2c5-4d44-81ac-8ed0e3241405'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.222906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ec3e97f6574d99bef9e9345d8786e7', 'request_id': 'req-e8b293db-c2c5-4d44-81ac-8ed0e3241405'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.230111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fb58f-598f-453e-90d0-7b93552a6e2f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.234804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.235586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.235993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.236622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.257857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.257966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] The token cache is being invalidate because project b5ec3e97f6574d99bef9e9345d8786e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:50.257966 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.258139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.258227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e8b293db-c2c5-4d44-81ac-8ed0e3241405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.258227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1074/2148] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:49 2022] DELETE /identity/v3/projects/b5ec3e97f6574d99bef9e9345d8786e7 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:50.258227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775805a2-7b19-43b7-9a65-00012374de13 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.258227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775805a2-7b19-43b7-9a65-00012374de13 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.258227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775805a2-7b19-43b7-9a65-00012374de13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.258702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1075/2149] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:50.258702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.258702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.266837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1019eace-baf0-430c-a0a0-856300706405 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.267647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-775805a2-7b19-43b7-9a65-00012374de13 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:50.269028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-775805a2-7b19-43b7-9a65-00012374de13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.271479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.272150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.272426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.272692 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] PATH_INFO: `/v3/projects/819d929236ae435f9fe055d18cdf5e28/users/b1fe73f46be6428bb4a4f0b0d8464d4d/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.275099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=819d929236ae435f9fe055d18cdf5e28, user_id=b1fe73f46be6428bb4a4f0b0d8464d4d, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.277616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1075/2150] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:50.277829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6adde-691a-4b20-9613-04422f54ea4c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.285228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.286193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.286193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.289066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1076/2151] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:50 2022] PUT /identity/v3/projects/819d929236ae435f9fe055d18cdf5e28/users/b1fe73f46be6428bb4a4f0b0d8464d4d/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:50.300658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.300951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.301228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.306090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:50.307300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.330393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] MFA Rules not processed for user `b1fe73f46be6428bb4a4f0b0d8464d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:50.331586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.392377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1076/2152] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:50.397324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.413950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839926-e98f-406a-99da-fc517e2d66a1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.428504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.429132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.429412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.429685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.431318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:50.431625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.440537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1077/2153] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:50.453777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.455413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.457186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.479566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1077/2154] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:50.483897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.498108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765af57c-ae69-42e6-aa7a-4843defc544b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.503589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.504597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.505090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.505536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.506329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.508973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.543451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b34e00-91e9-45c0-8409-a90b6740cd85 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.551509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.552175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.552460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.552734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.567724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.569912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.581827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1078/2155] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:50.635217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1078/2156] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:50 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:50.637039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.647249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084ea8c-d53d-473d-bf66-5992ada98b16 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.703991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.704597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.704898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.705171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.705826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.707727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.725716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.734743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.753741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08477b8-4d5d-4750-b75e-ee6c92b1138d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.761552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.762284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.762627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.762979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] PATH_INFO: `/v3/projects/7c021c5b1f4644cd9572aeca08c99576` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.764171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c021c5b1f4644cd9572aeca08c99576)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.768429 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.812323 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1079/2157] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:50 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:50.816880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.826427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3cc0b-5ec2-4762-b7c3-f43c26359a00 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.831213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.831805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.832111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.832383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.833016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.834602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.845030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1080/2158] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:50.849066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.859417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286010ff-8126-4893-b209-a72012de0672 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.863996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.864701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.864985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.865245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.865878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.873121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:50.882904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1081/2159] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:50.883953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.885657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c021c5b1f4644cd9572aeca08c99576', 'request_id': 'req-d579386b-d546-4902-81f3-4736e8f9744c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.894312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c31c0-bbb7-4fbe-b1a4-be3ad071c64e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:50.921379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:50.942943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c021c5b1f4644cd9572aeca08c99576', 'request_id': 'req-d579386b-d546-4902-81f3-4736e8f9744c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.949094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c021c5b1f4644cd9572aeca08c99576', 'request_id': 'req-d579386b-d546-4902-81f3-4736e8f9744c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.951625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:50.952327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:50.952613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:50.952882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] PATH_INFO: `/v3/projects/4c3b3432c3d9412ba8411646dea2427e/users/500a40746f1b4d79bbde9545916c5305/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:50.961023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] The token cache is being invalidate because project 7c021c5b1f4644cd9572aeca08c99576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:50.961316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.962478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:50.964111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1079/2160] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:50 2022] DELETE /identity/v3/projects/7c021c5b1f4644cd9572aeca08c99576 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:50.965025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:50.966313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:50.972190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3b3432c3d9412ba8411646dea2427e, user_id=500a40746f1b4d79bbde9545916c5305, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:50.974990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3659dd0-9bf1-4678-b6a5-c050588d60a7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.024771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579386b-d546-4902-81f3-4736e8f9744c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.028617 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.029906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.030208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.030875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.032832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.053754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1082/2161] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:50 2022] PUT /identity/v3/projects/4c3b3432c3d9412ba8411646dea2427e/users/500a40746f1b4d79bbde9545916c5305/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:51.055291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b18-3286-443a-83a9-1feb4aa2b454 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.055647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b18-3286-443a-83a9-1feb4aa2b454 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.056041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d76b18-3286-443a-83a9-1feb4aa2b454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.075961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:51.077240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c1d76b18-3286-443a-83a9-1feb4aa2b454 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:51.078569 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c1d76b18-3286-443a-83a9-1feb4aa2b454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.096995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.098492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcb852-d570-4423-a043-b532672ac340 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.108424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1080/2162] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:51.109810 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.110104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.110382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.142941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] MFA Rules not processed for user `500a40746f1b4d79bbde9545916c5305`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:51.144472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.147124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1083/2163] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:51.158289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.158688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.159041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.182288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:51.183660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.194749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1084/2164] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:51.198243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.209666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea0e51d-3ffd-4514-83ae-fb3f6917033f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.216759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.218042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.218566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.219033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.219824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:51.220250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.223581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.227223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1081/2165] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:51.231625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.233442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.240799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1085/2166] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:01:51.243637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.261554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e3389-c23d-463e-bfc4-b7c0e3d0f892 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.262136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3167610-db1e-41de-b870-6a9185f3e766 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.267471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.268194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.268655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.269011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.269310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.269865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.270364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.270652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.270933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.271576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.272526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.275758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.388372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1086/2167] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:51.390312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1082/2168] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:51.392571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.395485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.464448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d59d0-41ba-4c50-a7ee-210960326246 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.465293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438b0a4-08e9-44e3-980d-b9f607e043e7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.469887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.470255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.470733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.470835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.471060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.471153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.471339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.471634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.472008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.472651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.474913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.476754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.579826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1087/2169] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:51.583868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.591637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1083/2170] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:51.595426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.597119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6080aa-0f12-49c4-b983-6c6468314d81 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.603393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.604299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.604584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.604900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.605730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e963c-cde8-4d28-ba74-564bce003a56 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.607555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.607555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.610556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.611158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.611716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.611716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.612574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.614170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.618856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1088/2171] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:51.623135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.626918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1084/2172] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:51.634213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.635883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a5f39-8ab6-4067-a148-02a2348a98c6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.640787 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.641363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.641644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.641915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.642581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.644264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.645029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d9d8e-55ba-4a33-976a-76895e8386ef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.650480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.656575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.656575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.656575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.656575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.656575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.656943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1089/2173] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:51.660400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.665863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1085/2174] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:51.669970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.670694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd05cd-1c63-4e6a-8573-97d22d740373 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.676198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.676871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.679520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.679824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] PATH_INFO: `/v3/projects/a1390a73a7864e27a5a6f360c820d891/users/d87d99e5064747a395ba82e0eb8dde1c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.680919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d8ae8-d268-4105-ba8d-528b0acc246d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.685852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:51.686510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.686793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.687064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] PATH_INFO: `/v3/projects/be8ecd856d014b6d9d2878f091e16788/users/32bef6a2956143c7ab61ed29ee84d353/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.699442 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1390a73a7864e27a5a6f360c820d891, user_id=d87d99e5064747a395ba82e0eb8dde1c, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.703011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8ecd856d014b6d9d2878f091e16788, user_id=32bef6a2956143c7ab61ed29ee84d353, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:51.705387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd63feb-69ba-4723-9edd-8f849cbf112c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.705748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb26c6-42b9-4a20-8051-8bdea236f757 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:51.807074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1086/2175] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:51 2022] PUT /identity/v3/projects/be8ecd856d014b6d9d2878f091e16788/users/32bef6a2956143c7ab61ed29ee84d353/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:51.807237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1090/2176] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:51 2022] PUT /identity/v3/projects/a1390a73a7864e27a5a6f360c820d891/users/d87d99e5064747a395ba82e0eb8dde1c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:51.818472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.818783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.819064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.819348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:51.819637 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:51.819936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:51.847416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] MFA Rules not processed for user `32bef6a2956143c7ab61ed29ee84d353`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:51.848704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.848818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] MFA Rules not processed for user `d87d99e5064747a395ba82e0eb8dde1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:51.849899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:51.916010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1091/2177] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:51.919387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1087/2178] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:51.920258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.923738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:51.994829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3906-7d20-44f4-9431-2ce26a3f3af8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:51.995117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac137fe3-9b49-4c23-b4db-346e18e29da2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.000405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.001212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.001566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.001900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.002609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.004865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.005001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.005522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.005815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.006090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.006755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.009233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.153818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1088/2179] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:52.157929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.159195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1092/2180] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:51 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:52.163104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.224588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95277d-6ddb-4f24-ae9d-1e053c7b6e49 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.225669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794c3a-b113-48ce-9c38-d2ae403a8489 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.229499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.230216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.230381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.230492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.230759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.231027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.231313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.231414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.231594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.232269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.233353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.234161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.345146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1089/2181] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:52 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:52.349025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.358405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275437f1-c8e5-4bf0-a374-6537f2c6bbe4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.363054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.363643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.363942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.364228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.367576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.367576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.369182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1093/2182] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:52 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:52.372751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.379946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1090/2183] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:52.382820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dcc16d-72ba-4f34-9ce7-a4d18df3edda admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.384574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.388492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.389137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.389422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.389695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.390335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.392110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.394090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaeab20-7b91-4981-a5d5-a62091075cce admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.398838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.402236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.402236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.402236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] PATH_INFO: `/v3/projects/252fb3b03ef64eda99bc070d072c2deb/users/22650a4c9bf34067a93d1e7e696afcee/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.403659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1094/2184] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:52.407142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.415142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252fb3b03ef64eda99bc070d072c2deb, user_id=22650a4c9bf34067a93d1e7e696afcee, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.417324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a66e83-8c87-41d9-97e4-257d3fae8324 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.417871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.422096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.422756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.423037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.423320 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] PATH_INFO: `/v3/projects/f665d69ace2347e0a4d776f68cf14d88/users/7f93fe212a5b470eb91addc557a3542b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.439051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f665d69ace2347e0a4d776f68cf14d88, user_id=7f93fe212a5b470eb91addc557a3542b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.442013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.459599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:52.530396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1095/2185] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:52 2022] PUT /identity/v3/projects/f665d69ace2347e0a4d776f68cf14d88/users/7f93fe212a5b470eb91addc557a3542b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:52.535433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.535647 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1091/2186] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:52 2022] PUT /identity/v3/projects/252fb3b03ef64eda99bc070d072c2deb/users/22650a4c9bf34067a93d1e7e696afcee/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:52.541385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.615026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b21c-b933-43c0-b2f0-be1eb3422ed8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.615254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e1e51-c482-423b-9075-f3a6eadd4f4c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.620747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.621383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.621663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.621843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.621982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.622575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.622959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.623381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.624981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.629646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.632415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.636020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.641423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1096/2187] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:52.645249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.659622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1092/2188] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:52.660865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.662894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716ce8c-dd3d-416f-972e-5919aa04cc8b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.670809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.671517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.671799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.672104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] PATH_INFO: `/v3/projects/f665d69ace2347e0a4d776f68cf14d88/users/7f93fe212a5b470eb91addc557a3542b/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.674083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f665d69ace2347e0a4d776f68cf14d88, user_id=7f93fe212a5b470eb91addc557a3542b, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.674670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a1908b-cb73-478a-9930-6594677f817a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.676845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8620ad-a658-4747-8b0a-da785e0ddd1b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.679547 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.681119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.687608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.687608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] PATH_INFO: `/v3/projects/252fb3b03ef64eda99bc070d072c2deb/users/22650a4c9bf34067a93d1e7e696afcee/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.687608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252fb3b03ef64eda99bc070d072c2deb, user_id=22650a4c9bf34067a93d1e7e696afcee, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.687608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224fc619-57e5-4068-9e74-c61f3b335269 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.693865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1097/2189] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:52 2022] PUT /identity/v3/projects/f665d69ace2347e0a4d776f68cf14d88/users/7f93fe212a5b470eb91addc557a3542b/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:52.699116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.699661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.700040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.704837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1093/2190] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:52 2022] PUT /identity/v3/projects/252fb3b03ef64eda99bc070d072c2deb/users/22650a4c9bf34067a93d1e7e696afcee/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:52.719495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.719819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.720137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.730716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] MFA Rules not processed for user `7f93fe212a5b470eb91addc557a3542b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:52.732088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:52.754916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] MFA Rules not processed for user `22650a4c9bf34067a93d1e7e696afcee`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:52.756554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:52.827426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1098/2191] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:52.837811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.869980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1094/2192] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:01:52.879834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:52.881391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:52.934410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364e3fd-da63-43e5-a3ce-95dac052ad2f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.938503 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.939136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.939470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.940047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.952275 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:52.955337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:52.955984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b73a39-9bd0-42bc-adde-dc143e05ba27 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:52.962484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:52.963442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:52.963717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:52.964047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:52.968301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1099/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:53.050276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:53.053272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:53.054971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9dfe16-c37f-477f-8b76-5bad9a53a605 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:53.069371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1095/2194] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:01:53.185214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c20e2-8bb7-43fe-a064-d4301193e7ac service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:53.191893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:53.192936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:53.193987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:53.194416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] PATH_INFO: `/v3/users/d87d99e5064747a395ba82e0eb8dde1c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:53.197063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87d99e5064747a395ba82e0eb8dde1c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:53.198309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:53.242744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:53.373070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87d99e5064747a395ba82e0eb8dde1c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:53.436074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87d99e5064747a395ba82e0eb8dde1c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:53.437094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87d99e5064747a395ba82e0eb8dde1c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:53.437730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87d99e5064747a395ba82e0eb8dde1c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:53.446603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87d99e5064747a395ba82e0eb8dde1c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:53.464708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1100/2195] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:53 2022] DELETE /identity/v3/users/d87d99e5064747a395ba82e0eb8dde1c => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:53.470969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:53.471369 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:53.471652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:53.490635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:53.498504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:53.551838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1096/2196] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:53.561578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:53.563073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:53.621170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c28a7-63dc-4835-981d-a6d6347da400 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:53.625509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:53.626297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:53.626586 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:53.626858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:53.639963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:53.641415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:53.652362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1101/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:54.194335 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:54.196028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:54.216425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad0c7-900a-4f61-91d8-69ac5f5f99ed None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:54.221229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:54.222032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:54.222319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:54.222595 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] PATH_INFO: `/v3/projects/a1390a73a7864e27a5a6f360c820d891` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:54.223738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1390a73a7864e27a5a6f360c820d891)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:54.225709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:54.335721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1390a73a7864e27a5a6f360c820d891', 'request_id': 'req-7d587254-74e3-40e1-b2ff-4919428a3dc5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.431607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1390a73a7864e27a5a6f360c820d891', 'request_id': 'req-7d587254-74e3-40e1-b2ff-4919428a3dc5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.437736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1390a73a7864e27a5a6f360c820d891', 'request_id': 'req-7d587254-74e3-40e1-b2ff-4919428a3dc5'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.449135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] The token cache is being invalidate because project a1390a73a7864e27a5a6f360c820d891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:54.449428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.450050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.451581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1097/2198] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:54 2022] DELETE /identity/v3/projects/a1390a73a7864e27a5a6f360c820d891 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:54.455543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:54.466041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5520-d465-40d0-b2c3-4ac3ddb73842 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:54.505509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:54.522646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:54.523280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:54.523563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:54.524366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] PATH_INFO: `/v3/users/7f93fe212a5b470eb91addc557a3542b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:54.525496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f93fe212a5b470eb91addc557a3542b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:54.527471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:54.719628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f93fe212a5b470eb91addc557a3542b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.853664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f93fe212a5b470eb91addc557a3542b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.854752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f93fe212a5b470eb91addc557a3542b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.855468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f93fe212a5b470eb91addc557a3542b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.863953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f93fe212a5b470eb91addc557a3542b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:54.882915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1102/2199] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:54 2022] DELETE /identity/v3/users/7f93fe212a5b470eb91addc557a3542b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:55.085779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:55.087989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:55.174570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d587254-74e3-40e1-b2ff-4919428a3dc5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:55.184440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:55.260130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:55.260860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.261715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.262165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.272406 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:55.339742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:55.341299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14d6bc-b9c5-4477-b3ef-5ba8a394de9e service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:55.350339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1098/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:55.380911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:55.382363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:55.468088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3cc5c-8014-4ce2-8c92-6c5de56c8980 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:55.475825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:55.475825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.475825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.475825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] PATH_INFO: `/v3/projects/f665d69ace2347e0a4d776f68cf14d88` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.476786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f665d69ace2347e0a4d776f68cf14d88)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:55.478809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:55.595795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f665d69ace2347e0a4d776f68cf14d88', 'request_id': 'req-febc83a0-0bfc-45e8-9a93-07ba1488a34b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:55.601435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f665d69ace2347e0a4d776f68cf14d88', 'request_id': 'req-febc83a0-0bfc-45e8-9a93-07ba1488a34b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:55.754367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f665d69ace2347e0a4d776f68cf14d88', 'request_id': 'req-febc83a0-0bfc-45e8-9a93-07ba1488a34b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:55.766374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] The token cache is being invalidate because project f665d69ace2347e0a4d776f68cf14d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:01:55.766664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:55.767318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-febc83a0-0bfc-45e8-9a93-07ba1488a34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:55.768864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1103/2201] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:55 2022] DELETE /identity/v3/projects/f665d69ace2347e0a4d776f68cf14d88 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:01:55.774898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.775372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.775507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.795886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:55.797155 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:55.858506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1099/2202] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:55.866336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.866626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.866908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.887568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:55.888822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:55.896865 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1104/2203] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:55.901125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:55.911233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d77117-3cf4-4d91-8aa1-985676a6f152 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:55.916737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:55.917356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.917626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.917925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.918581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:01:55.918890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:55.920594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:55.932721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1100/2204] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:01:55.936902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:55.946416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a293a-2c47-4e7d-b459-702483960014 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:55.951538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:55.952209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:55.952493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:55.952765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:55.953440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:55.955369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.058805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1105/2205] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:01:55 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:01:56.063142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:56.073571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25447e50-3c58-4f27-b6ad-2f7c3c17a0f3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:56.130881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:56.131529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.131982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.132265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.132906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:56.134859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.248121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1101/2206] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:01:56 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:01:56.252089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:56.262545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca97551-8ea3-4df9-b136-16f5f06db500 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:56.274341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:56.274341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.274341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.274341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.274818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:56.276495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.287534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1106/2207] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:01:56.292050 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:56.303311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c459abc-d899-4961-ac62-eee899e2edc6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:56.308962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:56.310289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.310826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.311350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.312288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:56.314666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4ea0c1-59eb-4eec-9f0e-be186da6bb02 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.331183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1102/2208] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:01:56.332419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:56.343226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9f3c9-985f-4ab8-bb7a-2a8c773c6631 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:56.347775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:56.351157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.351157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.351157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] PATH_INFO: `/v3/projects/a47a2d64d30d4c0ca511ad7b686e08f0/users/70f4db56fa0b433e82994fb1d2884210/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.362919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47a2d64d30d4c0ca511ad7b686e08f0, user_id=70f4db56fa0b433e82994fb1d2884210, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:56.365595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.396514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:56.455301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1107/2209] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:01:56 2022] PUT /identity/v3/projects/a47a2d64d30d4c0ca511ad7b686e08f0/users/70f4db56fa0b433e82994fb1d2884210/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:56.469892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.470295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.470587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.479687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:56.500502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] MFA Rules not processed for user `70f4db56fa0b433e82994fb1d2884210`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:56.501779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:56.571537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1103/2210] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:56.579127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:56.580941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:56.639007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9c3f4-8ff3-4347-947b-af2583bee184 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:56.642866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:56.643467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:56.643747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:56.644050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:56.653026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:56.654453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90a597-c50d-4c3e-a3bb-fd527c8e66c4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:56.663187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1108/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:56.949051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:57.220144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:57.232374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:57.233815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:57.250958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76843178-9b73-4c63-8876-436000d54ec4 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:57.254826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:57.255442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:57.255724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:57.256046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:57.257793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:57.323522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:57.325008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:57.335508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1104/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:57.859467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:57.939604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:58.372854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5887-b2c2-40d1-93be-197296978edb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:58.372854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5887-b2c2-40d1-93be-197296978edb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:58.372854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5887-b2c2-40d1-93be-197296978edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:58.399466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-267a5887-b2c2-40d1-93be-197296978edb None None] MFA Rules not processed for user `70f4db56fa0b433e82994fb1d2884210`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:58.400758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-267a5887-b2c2-40d1-93be-197296978edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:58.411732 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1109/2213] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:58.546838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:58.548495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:58.625350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df30f79-2263-4bc1-9bd3-fa9c92d5ff06 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:58.629671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:58.630350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:58.630572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:58.630911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] PATH_INFO: `/v3/users/a04cd7d550bf4a7fae53976f3957ffc9` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:58.632012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04cd7d550bf4a7fae53976f3957ffc9)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:58.633948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:58.720529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:58.825659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:58.983428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04cd7d550bf4a7fae53976f3957ffc9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:59.082140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04cd7d550bf4a7fae53976f3957ffc9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:59.082986 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04cd7d550bf4a7fae53976f3957ffc9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:59.083709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04cd7d550bf4a7fae53976f3957ffc9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:59.092492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04cd7d550bf4a7fae53976f3957ffc9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:01:59.112606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1105/2214] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:01:58 2022] DELETE /identity/v3/users/a04cd7d550bf4a7fae53976f3957ffc9 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:01:59.117128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:59.117607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:59.117713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:59.142574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:01:59.142574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:59.217319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1110/2215] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:01:59.224523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:59.225962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:59.290680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf7ad5-263e-467a-9d58-a6ed994259d4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:59.294779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:59.295383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:59.295659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:59.295946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:59.306901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:59.308405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:59.318219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1106/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:01:59.499359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:59.734173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:01:59.870608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:01:59.872154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:01:59.884823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4d1f7-b100-4642-ae6e-8f2eae26170b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:01:59.889576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:01:59.890243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:01:59.890530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:01:59.890877 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] PATH_INFO: `/v3/projects/c05efcde8c894071b41c44eafbbea1b7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:01:59.892908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05efcde8c894071b41c44eafbbea1b7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:01:59.895044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:01:59.949029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:00.012298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05efcde8c894071b41c44eafbbea1b7', 'request_id': 'req-42d98995-3c74-421b-a23a-8b3a544684e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.017824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05efcde8c894071b41c44eafbbea1b7', 'request_id': 'req-42d98995-3c74-421b-a23a-8b3a544684e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.076561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05efcde8c894071b41c44eafbbea1b7', 'request_id': 'req-42d98995-3c74-421b-a23a-8b3a544684e4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.089501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] The token cache is being invalidate because project c05efcde8c894071b41c44eafbbea1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:00.089789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.090426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.091938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1111/2217] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:01:59 2022] DELETE /identity/v3/projects/c05efcde8c894071b41c44eafbbea1b7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:00.096010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:00.106314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3412213-049a-4b36-b7c4-cdf48076f1ad service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:00.151758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:00.163353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:00.164013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:00.164299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:00.165092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] PATH_INFO: `/v3/users/b1fe73f46be6428bb4a4f0b0d8464d4d` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:00.166215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1fe73f46be6428bb4a4f0b0d8464d4d)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:00.168182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:00.373713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1fe73f46be6428bb4a4f0b0d8464d4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.388771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:00.471580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1fe73f46be6428bb4a4f0b0d8464d4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.472423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1fe73f46be6428bb4a4f0b0d8464d4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.473093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1fe73f46be6428bb4a4f0b0d8464d4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.481622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a4677b12-9bfa-4508-9a48-6da7843838a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1fe73f46be6428bb4a4f0b0d8464d4d'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:00.498676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1107/2218] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:00 2022] DELETE /identity/v3/users/b1fe73f46be6428bb4a4f0b0d8464d4d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:00.573958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:00.885381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:00.934110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:01.081570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:01.087678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:01.115372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d98995-3c74-421b-a23a-8b3a544684e4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:01.183437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:01.184118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.184537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.184815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] PATH_INFO: `/v3/projects/819d929236ae435f9fe055d18cdf5e28` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.185964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] RBAC: Authorizing `identity:delete_project(project_id=819d929236ae435f9fe055d18cdf5e28)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:01.191955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:01.324515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819d929236ae435f9fe055d18cdf5e28', 'request_id': 'req-44a41b7b-68da-4013-bb81-36a66797211b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:01.329994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819d929236ae435f9fe055d18cdf5e28', 'request_id': 'req-44a41b7b-68da-4013-bb81-36a66797211b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:01.425236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819d929236ae435f9fe055d18cdf5e28', 'request_id': 'req-44a41b7b-68da-4013-bb81-36a66797211b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:01.439805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] The token cache is being invalidate because project 819d929236ae435f9fe055d18cdf5e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:01.440202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:01.440953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-44a41b7b-68da-4013-bb81-36a66797211b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:01.447772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1112/2219] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:01 2022] DELETE /identity/v3/projects/819d929236ae435f9fe055d18cdf5e28 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:01.449259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.449656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.449956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.472126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:01.473700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:01.544862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1108/2220] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:01.552433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.552723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.553040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.574253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:01.575459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:01.583639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1113/2221] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:01.587868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:01.592259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:01.597397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c4647-22ef-4702-931d-9a8a5b3a9a5c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:01.602513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:01.603105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.603384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.603692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.604482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:02:01.604788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:01.606366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:01.622090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1109/2222] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:02:01.623489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:01.633832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b6800-cab1-4833-9220-f8f4a0c9f8c7 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:01.639506 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:01.640196 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.641127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.641127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.641531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:01.644616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:01.799767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1114/2223] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:01 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:01.804099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:01.819311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:01.824726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a51747-a68b-489b-b9f2-35c9085df5e8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:01.910811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:01.911753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:01.912232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:01.912995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:01.913191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:01.916410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.048380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1110/2224] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:01 2022] POST /identity/v3/users => generated 288 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:02:02.052628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.063474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9d14b-28a4-473c-be12-0ba1d51403b3 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.068399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.069039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.069456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.069750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.070397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.072070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.089772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1115/2225] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:02.095600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.110521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562db7c-1007-4adc-a647-f1d32dc0707b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.116379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.122161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.122161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.122161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.122161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.122161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc889e-074a-4891-bc32-d491113332c1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.135594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1111/2226] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:02.140158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.155966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c01d2a-d585-4de5-9a63-6e26d6251f3a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.163374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.165250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.165799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.166357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] PATH_INFO: `/v3/projects/d12f59a8b9f5402bb277863814017a73/users/ed5ab8ca72c34560b47118e96bf7c753/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.188980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12f59a8b9f5402bb277863814017a73, user_id=ed5ab8ca72c34560b47118e96bf7c753, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.192369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.282987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1116/2227] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:02 2022] PUT /identity/v3/projects/d12f59a8b9f5402bb277863814017a73/users/ed5ab8ca72c34560b47118e96bf7c753/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:02.297534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.298316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.298316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.330901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] MFA Rules not processed for user `ed5ab8ca72c34560b47118e96bf7c753`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:02.332156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:02.405574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1112/2228] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:02.410276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.480289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf04209-50a3-4cbb-91ae-10e9b1cd6b51 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.485397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.485707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.486021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.486292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.486958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.488939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.621246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1117/2229] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:02 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:02.623904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.635073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35ae80-3367-4372-91fd-ceee2bf90d81 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.661928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.663981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:02.713755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.714794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.715204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.715711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.716645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.718959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.787783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387f43-b691-43fa-8319-92c5ed7754a1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.792687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.793325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.793614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.793896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] PATH_INFO: `/v3/users/500a40746f1b4d79bbde9545916c5305` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.795309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500a40746f1b4d79bbde9545916c5305)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.797298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.825745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:02.861474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1113/2230] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:02 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:02:02.868216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.878818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831e29e-22e8-4ddb-92fd-9d812720890d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.885735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.886567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.887213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.887324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.888017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.890017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.900609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1114/2231] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:02:02.904565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.914741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf5a187-98b2-4eb5-aedd-e21f2a682f95 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.919737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.920454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.920956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.921238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.922044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.923822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:02.935569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1115/2232] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:02:02.939813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:02.950906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035a337-70c3-45a4-85c1-f8fa1db3f427 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:02.957358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:02.957358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:02.957358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:02.957868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] PATH_INFO: `/v3/projects/d361c6e2c5514f20937b04a8a16d6202/users/c21d69940aae440f8aa8b4d699a64232/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:02.974020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d361c6e2c5514f20937b04a8a16d6202, user_id=c21d69940aae440f8aa8b4d699a64232, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:02.976803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14970-da01-4819-a850-1eac42884f12 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.006366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500a40746f1b4d79bbde9545916c5305'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:03.050577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1116/2233] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:02 2022] PUT /identity/v3/projects/d361c6e2c5514f20937b04a8a16d6202/users/c21d69940aae440f8aa8b4d699a64232/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:02:03.061339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be58a-1fec-4f73-8900-438400706f67 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.061630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be58a-1fec-4f73-8900-438400706f67 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.061910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489be58a-1fec-4f73-8900-438400706f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.065268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500a40746f1b4d79bbde9545916c5305'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:03.066038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500a40746f1b4d79bbde9545916c5305'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:03.066975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500a40746f1b4d79bbde9545916c5305'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:03.074698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9f6de800-747e-49c3-8479-ae672babb6d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500a40746f1b4d79bbde9545916c5305'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:03.089805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-489be58a-1fec-4f73-8900-438400706f67 None None] MFA Rules not processed for user `c21d69940aae440f8aa8b4d699a64232`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:03.091037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-489be58a-1fec-4f73-8900-438400706f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:03.092260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1118/2234] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:02 2022] DELETE /identity/v3/users/500a40746f1b4d79bbde9545916c5305 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:02:03.096940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.097226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.097718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.118749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:03.120999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:03.136636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:03.165469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1117/2235] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:02:03.170184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be58a-1fec-4f73-8900-438400706f67 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.172174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-489be58a-1fec-4f73-8900-438400706f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:03.211533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1119/2236] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:02:03.225448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.227791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:03.270944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489be58a-1fec-4f73-8900-438400706f67 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.292946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.293590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.293900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.294179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.294832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.296825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.346933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6aed8d-17fa-4155-8a6e-63135b39375d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.352734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.353368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.353651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.353920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.370682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.370682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.378943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1120/2237] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:02:03.404631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1118/2238] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:03 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:03.408940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.435851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8d835-a520-4412-b84f-284e58a06971 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.510016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.510864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.510943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.511163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.511870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.513864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.639500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1121/2239] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:03 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:03.643629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.661101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1165f1f1-1ea6-4eac-98c7-cfa730a02f59 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.670179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.671007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.671686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.672268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.673139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.676055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.692755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1119/2240] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:03.695792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.715700 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb200239-0338-4b25-9c5c-a9fffabe50c5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.721507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.722282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.722635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.722987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] PATH_INFO: `/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9/users/1aa7dade4280421781d2032aab3ec0f8/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.746193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa434e6c9c445e5b52c87ca78f808a9, user_id=1aa7dade4280421781d2032aab3ec0f8, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.749215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.830959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1122/2241] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:03 2022] PUT /identity/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9/users/1aa7dade4280421781d2032aab3ec0f8/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:03.836075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.851140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f65d3-4e0b-4990-979c-c0be4fd5c373 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.905452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.907334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:03.962436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:03.963323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:03.963578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:03.963824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:03.964559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:03.966170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:03.977711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1120/2242] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:03.983208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:03.990671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a20a6-9782-4fa9-bcf7-8645af624f06 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:03.999491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:04.000187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:04.000553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:04.000832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] PATH_INFO: `/v3/projects/4c3b3432c3d9412ba8411646dea2427e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:04.002202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3b3432c3d9412ba8411646dea2427e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:04.002742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de2788-d7df-45e3-9f0c-4d41de093d6e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:04.004675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:04.011969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:04.011969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:04.011969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:04.012443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] PATH_INFO: `/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9/users/1aa7dade4280421781d2032aab3ec0f8/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:04.014559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa434e6c9c445e5b52c87ca78f808a9, user_id=1aa7dade4280421781d2032aab3ec0f8, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:04.017598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091dc45-29e6-486e-bfe2-d99caeeb89fc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:04.031697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1121/2243] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:03 2022] PUT /identity/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9/users/1aa7dade4280421781d2032aab3ec0f8/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:04.055995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:04.056605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:04.056700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:04.114687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] MFA Rules not processed for user `1aa7dade4280421781d2032aab3ec0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:04.115848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:04.186766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3b3432c3d9412ba8411646dea2427e', 'request_id': 'req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.194255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3b3432c3d9412ba8411646dea2427e', 'request_id': 'req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.237731 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1122/2244] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:04.246779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:04.248261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:04.304321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc54ec-f77e-40cb-aa25-d8ffe5d571fe None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:04.314435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3b3432c3d9412ba8411646dea2427e', 'request_id': 'req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.327356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:04.333495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] The token cache is being invalidate because project 4c3b3432c3d9412ba8411646dea2427e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:04.334072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.336041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.339529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1123/2245] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:03 2022] DELETE /identity/v3/projects/4c3b3432c3d9412ba8411646dea2427e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:04.343433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:04.345124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:04.373297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:04.373813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:04.374097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:04.374609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:04.376165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:04.417314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf718e13-2ec8-450d-8e7a-d74b12bb5fdb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:04.425096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:04.425751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:04.426034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:04.426315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] PATH_INFO: `/v3/users/32bef6a2956143c7ab61ed29ee84d353` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:04.427492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bef6a2956143c7ab61ed29ee84d353)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:04.429928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:04.444315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:04.446322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:04.457127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1123/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:02:04.646730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bef6a2956143c7ab61ed29ee84d353'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.659547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:04.779466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bef6a2956143c7ab61ed29ee84d353'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.780614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bef6a2956143c7ab61ed29ee84d353'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.784962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bef6a2956143c7ab61ed29ee84d353'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.791612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bef6a2956143c7ab61ed29ee84d353'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:04.828076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1124/2247] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:04 2022] DELETE /identity/v3/users/32bef6a2956143c7ab61ed29ee84d353 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:02:05.350832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:05.365313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291d14-4fe0-46bd-9227-6fb4b6964364 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:05.454836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:05.455404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:05.455689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:05.456000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] PATH_INFO: `/v3/projects/be8ecd856d014b6d9d2878f091e16788` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:05.457162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8ecd856d014b6d9d2878f091e16788)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:05.459147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:05.578577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8ecd856d014b6d9d2878f091e16788', 'request_id': 'req-122b4d06-dd1f-4176-a2e5-810073eee340'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:05.657116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8ecd856d014b6d9d2878f091e16788', 'request_id': 'req-122b4d06-dd1f-4176-a2e5-810073eee340'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:05.666205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8ecd856d014b6d9d2878f091e16788', 'request_id': 'req-122b4d06-dd1f-4176-a2e5-810073eee340'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:05.685076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] The token cache is being invalidate because project be8ecd856d014b6d9d2878f091e16788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:05.685375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:05.686471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:05.688291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1124/2248] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:05 2022] DELETE /identity/v3/projects/be8ecd856d014b6d9d2878f091e16788 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:05.692370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:05.693824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:05.708325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede852-e3bb-42c1-97d3-e6e2a3a7a501 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:05.778977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:05.779765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:05.780178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:05.780567 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] PATH_INFO: `/v3/users/22650a4c9bf34067a93d1e7e696afcee` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:05.781932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22650a4c9bf34067a93d1e7e696afcee)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:05.784193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:05.920614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:06.020103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22650a4c9bf34067a93d1e7e696afcee'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:06.138763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22650a4c9bf34067a93d1e7e696afcee'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:06.139555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22650a4c9bf34067a93d1e7e696afcee'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:06.144054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22650a4c9bf34067a93d1e7e696afcee'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:06.154324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22650a4c9bf34067a93d1e7e696afcee'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:06.173997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1125/2249] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:05 2022] DELETE /identity/v3/users/22650a4c9bf34067a93d1e7e696afcee => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:06.288216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:06.659423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:06.661100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:06.722862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b4d06-dd1f-4176-a2e5-810073eee340 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:06.772968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:06.773511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:06.773819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:06.774093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:06.775830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:06.805956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:06.807357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:06.859671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:06.861581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a21c-f357-4e21-a101-813a8e4a15b2 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:06.875329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1125/2250] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:06.919207 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287586b7-7a4b-44f2-9b91-226af27bfd30 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:06.924200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:06.925079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:06.925368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:06.925632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] PATH_INFO: `/v3/projects/252fb3b03ef64eda99bc070d072c2deb` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:06.927014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252fb3b03ef64eda99bc070d072c2deb)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:06.929054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:07.073419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252fb3b03ef64eda99bc070d072c2deb', 'request_id': 'req-f9ab363f-22e9-4de2-87af-2ea3c5011f49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:07.081738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252fb3b03ef64eda99bc070d072c2deb', 'request_id': 'req-f9ab363f-22e9-4de2-87af-2ea3c5011f49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:07.162694 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252fb3b03ef64eda99bc070d072c2deb', 'request_id': 'req-f9ab363f-22e9-4de2-87af-2ea3c5011f49'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:07.176027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] The token cache is being invalidate because project 252fb3b03ef64eda99bc070d072c2deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:07.176398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:07.177193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:07.179536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1126/2251] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:06 2022] DELETE /identity/v3/projects/252fb3b03ef64eda99bc070d072c2deb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:07.497509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:07.510036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:07.510357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:07.510656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:07.530621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] MFA Rules not processed for user `bc7fd21870f94086a6a0325650a49d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:07.531866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:07.588819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1126/2252] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:08.097025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.370647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:08.372200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:08.429309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab363f-22e9-4de2-87af-2ea3c5011f49 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:08.433957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:08.434588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:08.434987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:08.441945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:08.441945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:08.491739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:08.524940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:08.526826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cd911-e76b-49db-b060-c41d14c41ecf service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:08.538693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1127/2253] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:09.539329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:09.665010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:10.442851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:10.660648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:11.206742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:11.468870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:12.006594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:12.217306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:12.526536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:12.916060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:13.223562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:13.234211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:13.235865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:13.301127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c753a4-5405-4be4-906d-c4af027cd1d8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:13.306916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:13.308215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:13.308495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:13.309399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] PATH_INFO: `/v3/users/ed5ab8ca72c34560b47118e96bf7c753` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:13.310538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5ab8ca72c34560b47118e96bf7c753)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:13.312543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:13.491706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5ab8ca72c34560b47118e96bf7c753'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:13.557001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5ab8ca72c34560b47118e96bf7c753'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:13.557655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5ab8ca72c34560b47118e96bf7c753'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:13.558294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5ab8ca72c34560b47118e96bf7c753'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:13.566040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5ab8ca72c34560b47118e96bf7c753'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:13.584781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1127/2254] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:13 2022] DELETE /identity/v3/users/ed5ab8ca72c34560b47118e96bf7c753 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:13.590171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:13.590657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:13.591860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:13.629396 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:13.630858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:13.704974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1128/2255] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:13.715520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:13.716984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:13.729467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:13.776581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e004ebe-341d-47ec-bb93-cf6b5b476806 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:13.780251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:13.780864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:13.781146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:13.781475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:13.790954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:13.792491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:13.803192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1128/2256] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:14.216995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:14.254975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:14.256459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:14.260315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:14.271630 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de63d67-21a7-4b70-9664-3ad10e9ee1cd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:14.276785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:14.277436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:14.277719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:14.277993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] PATH_INFO: `/v3/projects/d12f59a8b9f5402bb277863814017a73` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:14.279161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12f59a8b9f5402bb277863814017a73)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:14.284496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:14.385766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12f59a8b9f5402bb277863814017a73', 'request_id': 'req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.391343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12f59a8b9f5402bb277863814017a73', 'request_id': 'req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.453121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12f59a8b9f5402bb277863814017a73', 'request_id': 'req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.477182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] The token cache is being invalidate because project d12f59a8b9f5402bb277863814017a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:14.477479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.478278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.480178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1129/2257] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:14 2022] DELETE /identity/v3/projects/d12f59a8b9f5402bb277863814017a73 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:14.484039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:14.494545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e830c-3457-4e0a-a6bc-ae6f1e71ac18 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:14.548970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:14.549603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:14.549886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:14.550161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] PATH_INFO: `/v3/users/c21d69940aae440f8aa8b4d699a64232` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:14.551341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21d69940aae440f8aa8b4d699a64232)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:14.553327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:14.594172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:14.746148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:14.782427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21d69940aae440f8aa8b4d699a64232'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.813622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:14.887728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21d69940aae440f8aa8b4d699a64232'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.888308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21d69940aae440f8aa8b4d699a64232'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.888944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21d69940aae440f8aa8b4d699a64232'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.896847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21d69940aae440f8aa8b4d699a64232'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:14.919671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1129/2258] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:14 2022] DELETE /identity/v3/users/c21d69940aae440f8aa8b4d699a64232 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:02:15.343183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:15.586154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:15.765755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:15.767987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:15.783162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f05a8-4b3c-4eb8-bd1b-e7840162fcb6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:15.843332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:15.844050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:15.844329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:15.844602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] PATH_INFO: `/v3/projects/d361c6e2c5514f20937b04a8a16d6202` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:15.845713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d361c6e2c5514f20937b04a8a16d6202)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:15.847612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:15.945701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd361c6e2c5514f20937b04a8a16d6202', 'request_id': 'req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:15.951200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd361c6e2c5514f20937b04a8a16d6202', 'request_id': 'req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.019060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd361c6e2c5514f20937b04a8a16d6202', 'request_id': 'req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.032773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] The token cache is being invalidate because project d361c6e2c5514f20937b04a8a16d6202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:16.033072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.033725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.035520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1130/2259] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:15 2022] DELETE /identity/v3/projects/d361c6e2c5514f20937b04a8a16d6202 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:16.039764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:16.041371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:16.054068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043b6-9b8e-4ed7-9927-020fad9ef3fe admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:16.118037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:16.123118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:16.123118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:16.123118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] PATH_INFO: `/v3/users/1aa7dade4280421781d2032aab3ec0f8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:16.123118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa7dade4280421781d2032aab3ec0f8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:16.123118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:16.299813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa7dade4280421781d2032aab3ec0f8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.314007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:16.402931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa7dade4280421781d2032aab3ec0f8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.403599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa7dade4280421781d2032aab3ec0f8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.404261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa7dade4280421781d2032aab3ec0f8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.411900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f42cda5d-dbdb-43ad-888c-3ecdaea876f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa7dade4280421781d2032aab3ec0f8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:16.437880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1130/2260] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:16 2022] DELETE /identity/v3/users/1aa7dade4280421781d2032aab3ec0f8 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:16.486632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:16.739346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:16.832302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:16.834631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:16.851040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582a99d-dc52-4b4b-96c4-c1ad1f07529b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:16.903947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:16.916449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:16.917362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:16.918057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:16.919010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] PATH_INFO: `/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:16.920543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa434e6c9c445e5b52c87ca78f808a9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:16.922605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.078194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa434e6c9c445e5b52c87ca78f808a9', 'request_id': 'req-ab1421ba-4359-478e-b7b6-602959de858f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:17.088176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:17.091265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa434e6c9c445e5b52c87ca78f808a9', 'request_id': 'req-ab1421ba-4359-478e-b7b6-602959de858f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:17.155888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa434e6c9c445e5b52c87ca78f808a9', 'request_id': 'req-ab1421ba-4359-478e-b7b6-602959de858f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:17.168058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] The token cache is being invalidate because project 4fa434e6c9c445e5b52c87ca78f808a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:17.168468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:17.169189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ab1421ba-4359-478e-b7b6-602959de858f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:17.171011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1131/2261] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:16 2022] DELETE /identity/v3/projects/4fa434e6c9c445e5b52c87ca78f808a9 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:17.175641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.176123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.176348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.200185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:17.201502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:17.208063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:17.267494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1131/2262] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:17.297477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:17.337472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.337660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.337930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.361019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:17.362258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:17.371053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1132/2263] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:17.375795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.385908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fccfd61-0829-409d-b21f-bf9c18d39d04 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.390608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.391234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.391515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.391788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.392485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:02:17.392793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.394446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.407097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1132/2264] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:02:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:02:17.411425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.421707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274b38a-6b1f-4310-9a46-34cebc362368 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.426679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.427384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.427743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.428066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.428726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.431336 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.548817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1133/2265] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:17 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:17.557366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.571074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b21a64-cefe-4677-8689-818e601ade81 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.616258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:17.654245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.655039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.657524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.657524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.657524 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.658551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.831664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1133/2266] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:17 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:17.838308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.848759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e4fac-6369-49d7-a099-7968459299cf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.854044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.854667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.855087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.855413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.856017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.857693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.869226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1134/2267] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:17.872375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.882238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70238ed6-69da-4e2f-870e-9e76d16b4ce9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.886774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.887366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.887645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.887930 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.888584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.890161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e5ac80-cae0-4c4c-8c34-7d806cde6933 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:17.905994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1134/2268] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:17.911371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:17.926695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc375a-965e-413b-92e3-6876cec7a735 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:17.931607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:17.932310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:17.932587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:17.935455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] PATH_INFO: `/v3/projects/789c5f6d355041bd8b02794d7e890ba3/users/39951b39863945de9afd12289d9bff10/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:17.949508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] RBAC: Authorizing `identity:create_grant(project_id=789c5f6d355041bd8b02794d7e890ba3, user_id=39951b39863945de9afd12289d9bff10, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:17.952394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:18.072744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1135/2269] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:17 2022] PUT /identity/v3/projects/789c5f6d355041bd8b02794d7e890ba3/users/39951b39863945de9afd12289d9bff10/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:18.083893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a285b1-9af7-4f71-bbd8-0fb6daf82131 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:18.084222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a285b1-9af7-4f71-bbd8-0fb6daf82131 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:18.084914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a285b1-9af7-4f71-bbd8-0fb6daf82131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:18.117494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-04a285b1-9af7-4f71-bbd8-0fb6daf82131 None None] MFA Rules not processed for user `39951b39863945de9afd12289d9bff10`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:18.118842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-04a285b1-9af7-4f71-bbd8-0fb6daf82131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:18.184475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1135/2270] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:02:18.196858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:18.198556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:18.255545 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd163e6-66a1-430b-a7e9-1cf96a44814a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:18.259822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:18.260576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:18.260753 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:18.261025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:18.269400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:18.270833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:18.283516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1136/2271] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:18.540000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c303-08a8-4241-94ae-25762c62664d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:18.540292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c303-08a8-4241-94ae-25762c62664d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:18.540577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c303-08a8-4241-94ae-25762c62664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:18.574479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-11b4c303-08a8-4241-94ae-25762c62664d None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:18.575827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-11b4c303-08a8-4241-94ae-25762c62664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:18.637571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1136/2272] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:02:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:18.687015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:18.688733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:18.780423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd720-54fb-434b-9f03-26a33d67d11d service glance] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:18.785860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:18.786513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:18.787029 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:18.787302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:18.796602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:18.798192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:18.807191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1137/2273] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:19.679016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beb86-c1f2-47f5-abb2-851e37e5de40 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:19.679493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beb86-c1f2-47f5-abb2-851e37e5de40 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:19.679696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718beb86-c1f2-47f5-abb2-851e37e5de40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:19.702056 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-718beb86-c1f2-47f5-abb2-851e37e5de40 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:19.703306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-718beb86-c1f2-47f5-abb2-851e37e5de40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:19.710598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1137/2274] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:19.724373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:19.735889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784abcbb-9cf2-438a-8522-9ba669380aed service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:19.741412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:19.742050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:19.742335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:19.742610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:19.749211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:19.752378 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:19.754907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:19.764160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1138/2275] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:20.502591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98096-62a4-41d4-9bfb-7cd5065b4273 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:20.503347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98096-62a4-41d4-9bfb-7cd5065b4273 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:20.503634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e98096-62a4-41d4-9bfb-7cd5065b4273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:20.524940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-03e98096-62a4-41d4-9bfb-7cd5065b4273 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:20.526242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-03e98096-62a4-41d4-9bfb-7cd5065b4273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:20.533783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1138/2276] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:20.546558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:20.558585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b8c1d-a126-4ddb-876f-82fb9e4dc0de service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:20.563735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:20.564412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:20.564697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:20.564975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:20.574475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:20.576282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:20.584950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1139/2277] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:21.253341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:21.253778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:21.254096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:21.276493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:21.277950 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:21.286416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1139/2278] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:02:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:21.315310 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:21.326433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1dfc5-36d1-45a6-9dbd-432c81fa37b4 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:21.331848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:21.332496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:21.332780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:21.333105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:21.341697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:21.343286 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6599198-2827-47b6-8699-6a2c77d12c97 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:21.353081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1140/2279] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 14:02:24.140257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:24.142216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:24.180850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:24.228742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ef3dd-f7b3-4d39-af60-e014f37586e2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:24.234227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:24.234993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:24.235278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:24.235551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] PATH_INFO: `/v3/users/70f4db56fa0b433e82994fb1d2884210` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:24.236847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f4db56fa0b433e82994fb1d2884210)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:24.238714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:24.414250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f4db56fa0b433e82994fb1d2884210'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:24.516175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f4db56fa0b433e82994fb1d2884210'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:24.516886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f4db56fa0b433e82994fb1d2884210'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:24.517580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f4db56fa0b433e82994fb1d2884210'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:24.525528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f4db56fa0b433e82994fb1d2884210'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:24.554404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1140/2280] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:24 2022] DELETE /identity/v3/users/70f4db56fa0b433e82994fb1d2884210 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:24.560428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08196b-800b-4e38-af0c-2f5b247955a1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:24.561532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08196b-800b-4e38-af0c-2f5b247955a1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:24.561897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08196b-800b-4e38-af0c-2f5b247955a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:24.583609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2a08196b-800b-4e38-af0c-2f5b247955a1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:24.584924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a08196b-800b-4e38-af0c-2f5b247955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:24.666891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1141/2281] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:24.677006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:24.678622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:24.770080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4700e-c0d0-4f5d-9eb6-9e56046f8751 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:24.776488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:24.777359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:24.777649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:24.777929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:24.790989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:24.792628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:24.809162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1141/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:25.063152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.063450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.063949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.090420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:25.091724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.143516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:25.145730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.167809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0523a35-72e5-46b4-a421-b8631e5309d7 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:25.168361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1142/2283] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:25.173720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:25.174466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.174816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.175159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] PATH_INFO: `/v3/projects/a47a2d64d30d4c0ca511ad7b686e08f0` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.176512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47a2d64d30d4c0ca511ad7b686e08f0)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:25.178833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:25.189880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:25.200242 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.319160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:25.324548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47a2d64d30d4c0ca511ad7b686e08f0', 'request_id': 'req-05cc9a17-c3e0-48f4-9cd2-457217ead123'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:25.366300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59d35-eff9-4a19-96b1-8acd295702ec None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:25.390375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:25.405789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47a2d64d30d4c0ca511ad7b686e08f0', 'request_id': 'req-05cc9a17-c3e0-48f4-9cd2-457217ead123'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:25.412796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47a2d64d30d4c0ca511ad7b686e08f0', 'request_id': 'req-05cc9a17-c3e0-48f4-9cd2-457217ead123'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:25.430749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] The token cache is being invalidate because project a47a2d64d30d4c0ca511ad7b686e08f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:25.431370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:25.432380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-05cc9a17-c3e0-48f4-9cd2-457217ead123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:25.434741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1142/2284] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:25 2022] DELETE /identity/v3/projects/a47a2d64d30d4c0ca511ad7b686e08f0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:02:25.445894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7320-3b70-4b48-bbf8-dad6f388a7e5 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.446306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7320-3b70-4b48-bbf8-dad6f388a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.446492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7320-3b70-4b48-bbf8-dad6f388a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.471616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-122d7320-3b70-4b48-bbf8-dad6f388a7e5 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:25.473645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-122d7320-3b70-4b48-bbf8-dad6f388a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.498452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:25.499000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.499347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.499632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.502859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.595281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:25.595942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1143/2285] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:25.597052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.597349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.597635 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.598306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:25.621047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1143/2286] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:25.629682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:25.632265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:25.640512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1144/2287] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:25.644507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:25.658403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149012-b1ee-46d9-82e9-eb169aba32b6 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:25.664024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:25.664761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.665164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.665575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.666447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:02:25.666822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:25.668727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:25.689606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1144/2288] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:02:25.700918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:25.710927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20dbf04-59ec-4f14-ab5e-d5e13890da6c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:25.724408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:25.725118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.725488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.725828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.726561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:25.728674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:25.850410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1145/2289] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:25 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:02:25.851880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:25.871429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03131975-01e2-42c7-a1c0-d340b1e4cbe5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:25.976297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:25.977142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:25.977749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:25.978037 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:25.978782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:25.980887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:26.091403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1145/2290] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:25 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:26.095173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:26.112077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a913d3-fa96-4ba5-a6d1-1e1f96eddd73 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:26.126471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:26.127109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:26.127395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:26.127802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:26.131899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:26.133609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:26.154776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1146/2291] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:26.158618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:26.179983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59001-73f3-46f2-9101-f40006d09d05 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:26.196611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:26.197250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:26.197651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:26.197936 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:26.198583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:26.200212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba191f-a43f-4f6f-95f1-6b346f1ab6eb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:26.221144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1146/2292] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:26.225474 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:26.241159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf4e86-23af-431b-aa74-a7f5cef2ba6b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:26.246890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:26.248268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:26.249035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:26.250159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] PATH_INFO: `/v3/projects/11c275fb12e04fc79b9f2f93e5bdf48c/users/8b45c9445d9e496997c9daf67c72fe53/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:26.278099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c275fb12e04fc79b9f2f93e5bdf48c, user_id=8b45c9445d9e496997c9daf67c72fe53, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:26.282453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:26.400775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1147/2293] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:26 2022] PUT /identity/v3/projects/11c275fb12e04fc79b9f2f93e5bdf48c/users/8b45c9445d9e496997c9daf67c72fe53/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:26.411002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:26.411398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:26.411834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:26.496697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] MFA Rules not processed for user `8b45c9445d9e496997c9daf67c72fe53`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:26.498236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:26.528136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:26.653771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1147/2294] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:26.666243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:26.672004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:26.896749 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cbd59-2d0d-4b1f-aa3a-9b494d88bfd1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:26.905185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:26.906138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:26.906596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:26.907067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:26.919382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:26.926119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac109f-155e-48a3-8295-7f0153f2cdfd service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:26.937492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1148/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:34.672528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:34.741564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f69b0-bf6f-4765-b7d3-365d1393c441 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:34.746954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:34.747750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:34.748061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:34.748337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] PATH_INFO: `/v3/users/8b45c9445d9e496997c9daf67c72fe53` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:34.749491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b45c9445d9e496997c9daf67c72fe53)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:34.751755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:34.954153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b45c9445d9e496997c9daf67c72fe53'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:35.025031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b45c9445d9e496997c9daf67c72fe53'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:35.027535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b45c9445d9e496997c9daf67c72fe53'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:35.028365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b45c9445d9e496997c9daf67c72fe53'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:35.040133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b45c9445d9e496997c9daf67c72fe53'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:35.062102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1148/2296] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:34 2022] DELETE /identity/v3/users/8b45c9445d9e496997c9daf67c72fe53 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:35.068977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:35.068977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:35.068977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:35.091345 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:35.093741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:35.100355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:35.179387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1149/2297] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:35.189428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:35.190730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:35.235769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:35.261720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8683e-dadf-46b1-9f1a-1a9cfb867f89 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:35.265565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:35.266265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:35.266625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:35.266974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:35.280552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:35.284617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922fc30-3c4a-4451-83a9-0573f72e8489 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:35.294760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1149/2298] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:35.788503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:35.790087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:35.807070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7089eb2-6c03-4885-9414-12c1376b7537 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:35.811959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:35.812827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:35.813108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:35.813378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] PATH_INFO: `/v3/projects/11c275fb12e04fc79b9f2f93e5bdf48c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:35.814805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c275fb12e04fc79b9f2f93e5bdf48c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:35.827209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:35.959754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c275fb12e04fc79b9f2f93e5bdf48c', 'request_id': 'req-f861c7b1-8f84-4af9-994a-a0523f2e2353'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:36.044999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c275fb12e04fc79b9f2f93e5bdf48c', 'request_id': 'req-f861c7b1-8f84-4af9-994a-a0523f2e2353'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:36.051976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c275fb12e04fc79b9f2f93e5bdf48c', 'request_id': 'req-f861c7b1-8f84-4af9-994a-a0523f2e2353'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:36.066728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] The token cache is being invalidate because project 11c275fb12e04fc79b9f2f93e5bdf48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:36.067284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:36.068357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f861c7b1-8f84-4af9-994a-a0523f2e2353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:36.070296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1150/2299] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:35 2022] DELETE /identity/v3/projects/11c275fb12e04fc79b9f2f93e5bdf48c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:44.185055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.185593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.185758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.187263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1150/2300] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:02:44.193593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1106a7-21cd-4ccf-a978-b6990f76a083 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.194472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1106a7-21cd-4ccf-a978-b6990f76a083 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.194926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1106a7-21cd-4ccf-a978-b6990f76a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.215312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4c1106a7-21cd-4ccf-a978-b6990f76a083 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:44.216594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4c1106a7-21cd-4ccf-a978-b6990f76a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.288847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1151/2301] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:44.300458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:44.302174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.362171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08f4f7-e97a-4b41-b27c-c545eefaba64 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:44.365849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:44.366453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.366736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.367012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.377102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:44.381526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad140f3-c0bc-4bf2-b474-5db05ba78cde service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:44.389898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1151/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:44.570545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.570897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.571366 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.573707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1152/2303] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:02:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 14:02:44.578763 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039da35-efd5-454d-80ec-bf80006d70d1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.579161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039da35-efd5-454d-80ec-bf80006d70d1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.579679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039da35-efd5-454d-80ec-bf80006d70d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.637823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b039da35-efd5-454d-80ec-bf80006d70d1 None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:44.639090 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b039da35-efd5-454d-80ec-bf80006d70d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.693456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1152/2304] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:44.706016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:44.707708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.721267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b30845-2362-4839-8f2d-8ede923bb992 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:44.725036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:44.725658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.725933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.726208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.733703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:44.735141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bbaee1-a7f2-444c-a127-1c7914eea7b2 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:44.743165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1153/2305] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:44.825212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a5f-7110-4a78-8563-ee46a61d2f95 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.825507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a5f-7110-4a78-8563-ee46a61d2f95 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.825782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a42a5f-7110-4a78-8563-ee46a61d2f95 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.827134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1153/2306] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:02:44.831948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.832239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.832515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.852936 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:44.854177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.863550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1154/2307] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:02:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:44.874361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a5f-7110-4a78-8563-ee46a61d2f95 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:44.885872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a42a5f-7110-4a78-8563-ee46a61d2f95 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:44.889559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:44.890160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:44.890444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:44.890719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:44.900705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:44.902126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b0e59-7efa-42f2-87cb-0c1143f68912 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:44.912723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1154/2308] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:44.947379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:44.949434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:44.958960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:45.014710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0883e2f-201b-4769-be2b-2b014c609d5d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:45.020392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:45.021055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:45.021331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:45.021607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] PATH_INFO: `/v3/users/39951b39863945de9afd12289d9bff10` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:45.022754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39951b39863945de9afd12289d9bff10)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:45.025346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:45.198313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39951b39863945de9afd12289d9bff10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:45.287537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39951b39863945de9afd12289d9bff10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:45.288269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39951b39863945de9afd12289d9bff10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:45.288996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39951b39863945de9afd12289d9bff10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:45.298495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39951b39863945de9afd12289d9bff10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:45.319244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1155/2309] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:02:44 2022] DELETE /identity/v3/users/39951b39863945de9afd12289d9bff10 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:45.328934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:45.329438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:45.329563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:45.350848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:45.352357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:45.423419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1155/2310] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:45.432960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:45.434486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:45.499557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccc116c-de75-4fa4-a59b-8d482e10505e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:45.503420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:45.504099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:45.504381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:45.504677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:45.513688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:45.515185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aec66-e89d-4c7c-9785-6656a88de29a service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:45.524561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1156/2311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:46.075041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.076683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:46.090880 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c20921-65cd-4a31-85da-e3a3e22a13b1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.095861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.096532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.096816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.097084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] PATH_INFO: `/v3/projects/789c5f6d355041bd8b02794d7e890ba3` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.098662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] RBAC: Authorizing `identity:delete_project(project_id=789c5f6d355041bd8b02794d7e890ba3)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.100827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.112150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:46.216278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789c5f6d355041bd8b02794d7e890ba3', 'request_id': 'req-69d61382-88d9-4d26-82d7-baca5a6aaafc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:46.221862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789c5f6d355041bd8b02794d7e890ba3', 'request_id': 'req-69d61382-88d9-4d26-82d7-baca5a6aaafc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:46.289988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789c5f6d355041bd8b02794d7e890ba3', 'request_id': 'req-69d61382-88d9-4d26-82d7-baca5a6aaafc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:46.301921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] The token cache is being invalidate because project 789c5f6d355041bd8b02794d7e890ba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:02:46.302214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:46.302843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-69d61382-88d9-4d26-82d7-baca5a6aaafc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:02:46.304647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1156/2312] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:02:46 2022] DELETE /identity/v3/projects/789c5f6d355041bd8b02794d7e890ba3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:46.309757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.310231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.310231 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.330009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:46.331245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:46.355747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:46.391594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1157/2313] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:46.400314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.401313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.401415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.422761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:46.424024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:46.432356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1157/2314] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:46.436573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.446333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdfa24-eed0-4b9d-9904-85968fd7060e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.450888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.451479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.451756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.452089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.452730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:02:46.453032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.454697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.471196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1158/2315] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:02:46.471318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.481677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c7eab-5ed7-4136-a6b9-805f5ced4e0b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.486575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.487185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.487464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.487739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.488584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.491038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.583411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1158/2316] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:46 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:46.587791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.598690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f182ed2-2221-48aa-89e1-a5731afc3f14 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.655587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.656309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.656682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.657488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.658207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.660229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.856336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1159/2317] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:46 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:02:46.860478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.870990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b6de0-c6e9-4c1d-88d0-0c2e916a2fce admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.875480 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.876109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.876387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.876656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.877299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.878858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.889410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1159/2318] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:46.896099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.906758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5f74-2517-4dea-a7a9-c2535acc567d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.911857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.917037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.917037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.917037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.917037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.917037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4d538-7822-46b9-9e50-06d004f0ea58 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:46.926594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1160/2319] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:46.930761 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:46.941321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ebb42-33bd-440c-b4ee-8480d3f3e030 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:46.946246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:46.946905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:46.947188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:46.947463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] PATH_INFO: `/v3/projects/0a890bc7150149a8a4ff5b701b34f487/users/7ebbc532f3194302a58bb0e133124d36/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:46.964344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a890bc7150149a8a4ff5b701b34f487, user_id=7ebbc532f3194302a58bb0e133124d36, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:46.967170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:47.071064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1160/2320] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:46 2022] PUT /identity/v3/projects/0a890bc7150149a8a4ff5b701b34f487/users/7ebbc532f3194302a58bb0e133124d36/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:47.076785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271b56-3bf1-41b4-9de9-3065a330b527 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:47.077073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271b56-3bf1-41b4-9de9-3065a330b527 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:47.077338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85271b56-3bf1-41b4-9de9-3065a330b527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:47.096809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-85271b56-3bf1-41b4-9de9-3065a330b527 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:47.102352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-85271b56-3bf1-41b4-9de9-3065a330b527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:47.163588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1161/2321] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:02:47.173544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:47.175292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:47.233241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3624ed-d461-4ceb-8c29-00c6ee717908 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:47.237633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:47.238243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:47.238525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:47.238795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:47.249019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:47.250444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:47.260006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1161/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:02:48.820465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e672-75b0-4fcf-b56e-ad3dfc9daaf0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:48.820990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e672-75b0-4fcf-b56e-ad3dfc9daaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:48.821178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e672-75b0-4fcf-b56e-ad3dfc9daaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:48.844093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8af8e672-75b0-4fcf-b56e-ad3dfc9daaf0 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:48.845471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8af8e672-75b0-4fcf-b56e-ad3dfc9daaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:48.878281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:48.904215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1162/2323] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:02:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:48.917222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:48.918683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:48.968538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:02:49.005203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c5a88-d71c-4e1d-af2b-bb3051ceda81 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:49.013352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196154-2538-4424-8579-a107846b6545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:49.016224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196154-2538-4424-8579-a107846b6545 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:49.016224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196154-2538-4424-8579-a107846b6545 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:49.016224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29196154-2538-4424-8579-a107846b6545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:49.025918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196154-2538-4424-8579-a107846b6545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:49.028497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29196154-2538-4424-8579-a107846b6545 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:49.040840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1162/2324] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:02:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:02:53.748988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:53.749516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:53.749604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:53.782405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] MFA Rules not processed for user `7ebbc532f3194302a58bb0e133124d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:02:53.783634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:02:53.882316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1163/2325] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:02:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:02:53.884701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196154-2538-4424-8579-a107846b6545 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:53.896200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29196154-2538-4424-8579-a107846b6545 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:53.901321 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:53.901888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:53.902160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:53.902420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:53.903054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:53.905420 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.050322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1163/2326] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:02:53 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:54.054873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:54.066270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faaf17-ee86-4647-ab4f-e6196f0c5075 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:54.156526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:54.157448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:54.157996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:54.158447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:54.159423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:54.161935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.298457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1164/2327] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:02:54 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:02:54.304156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:54.327724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213ae4f-cecb-4d1d-91c3-ac14586d282d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:54.345269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:54.345926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:54.346220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:54.346505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:54.347173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:54.349077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.373267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1164/2328] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:02:54.374581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:54.401092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208e5cb-f2da-4f29-b520-4f33e00c6e78 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:54.423539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:54.424321 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:54.431669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:54.440856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] PATH_INFO: `/v3/projects/684451d979d34edf8eee84fd1cc28be2/users/0ad30cca9e1049a8b5902cc5ec301539/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:54.500739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=684451d979d34edf8eee84fd1cc28be2, user_id=0ad30cca9e1049a8b5902cc5ec301539, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:54.506980 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.594134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1165/2329] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:54 2022] PUT /identity/v3/projects/684451d979d34edf8eee84fd1cc28be2/users/0ad30cca9e1049a8b5902cc5ec301539/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:02:54.599089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:54.627267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07e6dd-2737-447f-a637-b2e3b226bda0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:54.750896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:54.752055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:54.752512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:54.752940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:54.753964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:54.756280 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f85e3-6b4f-499f-a083-a000b674be7a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.774412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1165/2330] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:02:54.778892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:02:54.800733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dfb0f-24c3-403d-869c-999a7f965b2c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:02:54.813353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:02:54.813353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:02:54.813353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:02:54.814377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] PATH_INFO: `/v3/projects/684451d979d34edf8eee84fd1cc28be2/users/0ad30cca9e1049a8b5902cc5ec301539/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:02:54.816280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684451d979d34edf8eee84fd1cc28be2, user_id=0ad30cca9e1049a8b5902cc5ec301539, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:02:54.823068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:02:54.843648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1166/2331] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:02:54 2022] PUT /identity/v3/projects/684451d979d34edf8eee84fd1cc28be2/users/0ad30cca9e1049a8b5902cc5ec301539/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:03:01.625878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed1eb1-bbd4-44d6-b9fb-1eac62fadc79 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:01.626426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed1eb1-bbd4-44d6-b9fb-1eac62fadc79 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:01.626426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed1eb1-bbd4-44d6-b9fb-1eac62fadc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:01.664357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d2ed1eb1-bbd4-44d6-b9fb-1eac62fadc79 None None] MFA Rules not processed for user `0ad30cca9e1049a8b5902cc5ec301539`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:03:01.667346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d2ed1eb1-bbd4-44d6-b9fb-1eac62fadc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:01.757675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1166/2332] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:03:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:03:01.772195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:03:01.773977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:01.803663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:01.855088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51450c32-682e-4287-abe8-4c7c445ac4a2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:03:01.864114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:03:01.864758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:01.865024 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:01.865300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:01.950549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:03:01.953098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81fece-3c6d-442c-a64c-2e568337eaba service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:03:01.971355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1167/2333] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:03:04.692807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:04.693292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:04.693387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:04.712314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] MFA Rules not processed for user `7ebbc532f3194302a58bb0e133124d36`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:03:04.713519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:04.720482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1167/2334] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:03:08.562047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9340ed-bd04-435a-aff4-d930139d9dd7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:08.562542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9340ed-bd04-435a-aff4-d930139d9dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:08.562673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9340ed-bd04-435a-aff4-d930139d9dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:08.584018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7c9340ed-bd04-435a-aff4-d930139d9dd7 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:03:08.585248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7c9340ed-bd04-435a-aff4-d930139d9dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:08.644621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1168/2335] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:03:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:03:08.656883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:03:08.666777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:08.724798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fa0be-bc46-45d2-a16d-b85f91daf7f1 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:03:08.729781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:03:08.730582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:08.730927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:08.731766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:08.742449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:03:08.744255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:03:08.760122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1168/2336] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:03:14.518010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9a191-2559-47a0-a351-3d66a935d50a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:14.518487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9a191-2559-47a0-a351-3d66a935d50a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:14.518580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9a191-2559-47a0-a351-3d66a935d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:14.538916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d8a9a191-2559-47a0-a351-3d66a935d50a None None] MFA Rules not processed for user `f3601003a5ca4b40a4c25ff3c4b3f712`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:03:14.540237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d8a9a191-2559-47a0-a351-3d66a935d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:14.598465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1169/2337] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:03:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:03:18.763898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=28 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:24.591645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:28.321526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:03:28.322942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:28.411950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4383dc-3442-412b-ad5c-08346369ed31 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:03:28.417153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:03:28.417796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:28.418076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:28.418349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:28.420134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:28.433096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:03:28.434960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:03:28.446043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1169/2338] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:03:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:03:31.042162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2634-ea28-40fb-a199-e256ea3fa095 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:31.047483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2634-ea28-40fb-a199-e256ea3fa095 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:31.047483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a2634-ea28-40fb-a199-e256ea3fa095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:31.061458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-932a2634-ea28-40fb-a199-e256ea3fa095 None None] MFA Rules not processed for user `bc7fd21870f94086a6a0325650a49d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:03:31.062661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-932a2634-ea28-40fb-a199-e256ea3fa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:31.119502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1170/2339] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:03:38.441370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=32 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:38.992848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:03:38.994348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:03:39.049128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8535b50b-9385-42ab-8d59-a3ade0f6433a service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:03:39.052725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:03:39.053322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:03:39.053603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:03:39.053876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:03:39.062581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:03:39.064080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1e8d-3b04-438c-9d90-2dbb8ce83eb0 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:03:39.073518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1170/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:03:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:03:41.112859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=25 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:03:49.069470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=26 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:01.914759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d73b-c768-4221-ab4c-c7ac178dc5f4 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:04:01.915310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d73b-c768-4221-ab4c-c7ac178dc5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:04:01.915414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4d73b-c768-4221-ab4c-c7ac178dc5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:04:01.935102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f6c4d73b-c768-4221-ab4c-c7ac178dc5f4 None None] MFA Rules not processed for user `47aa5cf320134658b77c2fc5e4debcde`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:04:01.936608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f6c4d73b-c768-4221-ab4c-c7ac178dc5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:04:01.991628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1171/2341] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:04:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:04:11.983606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=25 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:20.318543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9e87-8bbc-46d5-adfe-f5dfbfb797eb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:04:20.319290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9e87-8bbc-46d5-adfe-f5dfbfb797eb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:04:20.319423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff9e87-8bbc-46d5-adfe-f5dfbfb797eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:04:20.338921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4cff9e87-8bbc-46d5-adfe-f5dfbfb797eb None None] MFA Rules not processed for user `57e6a1e99a7c4dfd922299028a4ea809`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:04:20.340147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4cff9e87-8bbc-46d5-adfe-f5dfbfb797eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:04:20.393262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1171/2342] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:04:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:04:30.386522 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=25 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:04:41.610014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bd0b-278a-441a-bb25-88b5f5cb6c78 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:04:41.610544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bd0b-278a-441a-bb25-88b5f5cb6c78 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:04:41.610544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975bd0b-278a-441a-bb25-88b5f5cb6c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:04:41.628988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3975bd0b-278a-441a-bb25-88b5f5cb6c78 None None] MFA Rules not processed for user `f3601003a5ca4b40a4c25ff3c4b3f712`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:04:41.630172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3975bd0b-278a-441a-bb25-88b5f5cb6c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:04:41.636838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1172/2343] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:04:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:04:51.301349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:04:51.301840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:04:51.301934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:04:51.321464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] MFA Rules not processed for user `bc7fd21870f94086a6a0325650a49d3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:04:51.322664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:04:51.330574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1172/2344] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:04:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:04:51.623714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:01.315842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:17.056669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:17.057133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:17.057263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:17.077289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:17.081607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:17.086557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1173/2345] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:05:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:17.223188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:17.235593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19b1e8-43e4-4bcf-b1cf-dbbb4daf36b3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:17.240806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:17.244899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:17.244899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:17.244899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:17.249924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:17.251612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:17.259460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1173/2346] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:05:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:05:22.338132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:22.339551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:22.413813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b929695-8a1c-41cc-937c-b1d6814f5e2e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:22.417914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:22.418863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:22.419301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:22.420424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:22.423407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:22.440686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:22.442137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:22.455703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1174/2347] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:05:25.989066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:26.000724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ca76d-3454-4591-b0f0-c722bc6a3651 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:26.004602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:26.005233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:26.005520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:26.006626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:26.008607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:26.052056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:26.052056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945a3e2-0784-4e1c-b978-eea5c8256597 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:26.066267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1174/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:32.449854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=29 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:36.048605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=12 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:37.787275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:37.799340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f96b74-4271-4dcf-87f4-3d1cbd4b01a1 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:37.806163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:37.806925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:37.807183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:37.807461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:37.809250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:37.820281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:37.822143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab989-32fc-4852-b34b-d43bb0bb321f service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:37.831805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1175/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:39.725915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:39.725915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:39.725915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:39.727178 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1175/2350] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 14:05:39.733036 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb18c-b612-40e1-ad1b-85e0c9d8f260 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:39.733509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb18c-b612-40e1-ad1b-85e0c9d8f260 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:39.733609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb18c-b612-40e1-ad1b-85e0c9d8f260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:39.753461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2d2bb18c-b612-40e1-ad1b-85e0c9d8f260 None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:39.754677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2d2bb18c-b612-40e1-ad1b-85e0c9d8f260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:39.764743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1176/2351] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:05:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:05:39.778137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:39.780003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:39.837432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820033f5-28a8-4fcf-a475-a93e25e1512f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:39.841065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:39.841679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:39.841963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:39.842233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:39.852517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:39.854215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31918075-ad42-4ae5-a0dd-9ed23f7a1255 service glance] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:39.864802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1176/2352] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:40.050234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47973-0f11-4841-8edb-345aac94755f None None] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.050544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47973-0f11-4841-8edb-345aac94755f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.050823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc47973-0f11-4841-8edb-345aac94755f None None] PATH_INFO: `/` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.052323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1177/2353] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 14:05:40.057784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d893-ceb9-4b4f-9a51-517cbd60bc6a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.058077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d893-ceb9-4b4f-9a51-517cbd60bc6a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.058354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661d893-ceb9-4b4f-9a51-517cbd60bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.077990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4661d893-ceb9-4b4f-9a51-517cbd60bc6a None None] MFA Rules not processed for user `d222074760c44210aea4b01f334238ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:40.079185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4661d893-ceb9-4b4f-9a51-517cbd60bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:40.085652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1177/2354] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:40.099542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc47973-0f11-4841-8edb-345aac94755f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:40.110818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc47973-0f11-4841-8edb-345aac94755f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:40.114871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:40.115592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.116028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.116907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.124616 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:40.126026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbca318-f755-498d-aba6-2d844e8e9d57 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:40.133807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1178/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:40.216346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8b28-1768-44c5-bf9b-e9d7eccc6f57 None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.216634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8b28-1768-44c5-bf9b-e9d7eccc6f57 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.216909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8b28-1768-44c5-bf9b-e9d7eccc6f57 None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.218329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1178/2356] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:05:40.223618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.223909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.224242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.244379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] MFA Rules not processed for user `7ea62ee4cea94e3f941b4301885469ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:40.245593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:40.255066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1179/2357] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:05:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:05:40.265412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8b28-1768-44c5-bf9b-e9d7eccc6f57 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:40.276938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8b28-1768-44c5-bf9b-e9d7eccc6f57 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:40.281179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:40.281367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.281494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.281774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.292762 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:40.294186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:40.304889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1179/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:40.312757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:40.322462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f0d9f-0a09-4a4c-b49e-f0ab9a1ec20e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:40.326136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:40.326746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.327096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.327376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.329306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:40.340992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:40.344502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:40.352424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1180/2359] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Sep 23 14:05:40 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:40.413679 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:40.425590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cce58-bf70-4baf-b056-1f6e814e03f7 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:40.430789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:40.431391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:40.431674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:40.431979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:40.433714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:40.445043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:40.446891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63827531-63b9-4ed5-8dc6-458ad99ea40f service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:40.456790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1180/2360] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:42.740687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:42.749733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e486-b623-4f9c-996e-d3143665a47f service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:42.753270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:42.753896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:42.754173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:42.754452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:42.756197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:42.816646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:42.818067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:42.827834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1181/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:44.782077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668c6-2033-49b8-998d-d00eb3cc7af3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:44.782632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668c6-2033-49b8-998d-d00eb3cc7af3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:44.782632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0668c6-2033-49b8-998d-d00eb3cc7af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:44.804134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cb0668c6-2033-49b8-998d-d00eb3cc7af3 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:44.805405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cb0668c6-2033-49b8-998d-d00eb3cc7af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:44.812805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1181/2362] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:05:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:44.825921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:44.838715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5faca-4ab4-419e-a6da-d36d0b89b49a service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:44.844200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:44.844828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:44.845111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:44.845387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:44.856708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:44.858305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107293-cf6e-4048-b4bd-a9192205864b service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:44.867716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1182/2363] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:05:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 14:05:47.902829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad0c3-b3e9-4237-8c8e-c745427725ae None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:47.903788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad0c3-b3e9-4237-8c8e-c745427725ae None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:47.904279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ad0c3-b3e9-4237-8c8e-c745427725ae None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:47.905981 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1182/2364] 10.222.0.48 () {54 vars in 921 bytes} [Fri Sep 23 14:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 23 14:05:47.958158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714315f-59b7-441e-9531-50df63d94155 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:47.958663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714315f-59b7-441e-9531-50df63d94155 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:47.958881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714315f-59b7-441e-9531-50df63d94155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:47.997301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0714315f-59b7-441e-9531-50df63d94155 None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:48.000160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0714315f-59b7-441e-9531-50df63d94155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:48.020003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1183/2365] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Sep 23 14:05:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:48.026978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ad0c3-b3e9-4237-8c8e-c745427725ae None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:48.085019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ad0c3-b3e9-4237-8c8e-c745427725ae None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:48.091096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714315f-59b7-441e-9531-50df63d94155 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:48.093046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0714315f-59b7-441e-9531-50df63d94155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:48.105603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:48.105603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:48.105603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:48.106169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:48.123096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714315f-59b7-441e-9531-50df63d94155 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:48.130428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:48.135975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:48.136606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:48.137110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] PATH_INFO: `/v3/users/57e6a1e99a7c4dfd922299028a4ea809` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:48.138798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e6a1e99a7c4dfd922299028a4ea809)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:48.141098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:48.150405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:48.152691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:48.176888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1183/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:48.378488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e6a1e99a7c4dfd922299028a4ea809'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:48.465359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e6a1e99a7c4dfd922299028a4ea809'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:48.466892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e6a1e99a7c4dfd922299028a4ea809'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:48.467762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e6a1e99a7c4dfd922299028a4ea809'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:48.477846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f35b08e4-ece1-4440-8fb8-8ccd88c49e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e6a1e99a7c4dfd922299028a4ea809'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:48.490994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:48.500268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1184/2367] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:05:48 2022] DELETE /identity/v3/users/57e6a1e99a7c4dfd922299028a4ea809 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:05:48.761616 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:48.775572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa19f2-715b-4ed1-869c-457f5d272228 service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:48.853154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:48.853893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:48.854193 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:48.854459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] PATH_INFO: `/v3/projects/99fde9f47a1f41b695cbf021340bfb65` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:48.856082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99fde9f47a1f41b695cbf021340bfb65)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:48.858257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.001101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99fde9f47a1f41b695cbf021340bfb65', 'request_id': 'req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:49.004152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:49.026820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99fde9f47a1f41b695cbf021340bfb65', 'request_id': 'req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:49.117296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99fde9f47a1f41b695cbf021340bfb65', 'request_id': 'req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:49.140108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] The token cache is being invalidate because project 99fde9f47a1f41b695cbf021340bfb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:05:49.140570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:49.141465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-7d8908e9-18d5-4ac0-8dab-593e13ffbe31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:05:49.144013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1184/2368] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:05:48 2022] DELETE /identity/v3/projects/99fde9f47a1f41b695cbf021340bfb65 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:05:49.148424 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.149349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.149837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.172281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:49.173919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:49.252174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1185/2369] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:05:49.260447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.260846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.261192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.289068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:49.290590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:49.299575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1185/2370] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:05:49.303723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.314108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ae545-1dcb-431b-b34d-71515da0ebd0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.319264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.321421 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.321703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.321973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.322631 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:05:49.322932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.324550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.336996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1186/2371] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:05:49.341437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.351505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98219c-789d-43e1-8aba-7f8a5ab15604 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.356737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.357363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.357644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.357916 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.358553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.360738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.440707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1186/2372] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:05:49 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:05:49.444233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.455378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978fa8-5462-42ac-93a0-d71a92079070 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.536513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.537089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.537407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.537785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.538613 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.541133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.817864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1187/2373] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:05:49 2022] POST /identity/v3/users => generated 279 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:05:49.821160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.833697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b0474-2377-4032-af31-e2f4fc52e0f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.838801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.839430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.839716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.840043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.840682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.842334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.856633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1187/2374] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:05:49.857878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.869351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b21f2b-fca7-405c-8d8c-d2b944955240 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.878565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.879632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.880178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.880964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.881872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.884202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.897688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1188/2375] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:05:49.902384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.913455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad64251-e678-4604-be24-0e2cc14468f6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:49.919910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:49.920622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:49.920908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:49.921189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] PATH_INFO: `/v3/projects/92f0bf6087744ed1bdf5be62c6a8cb7b/users/991a168fa75e44889c69a2927ba66250/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:49.938760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f0bf6087744ed1bdf5be62c6a8cb7b, user_id=991a168fa75e44889c69a2927ba66250, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:49.941482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165fa0e-c8c1-437f-8f7d-813dd64f8d9e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:49.969622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:49.971565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:50.039954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:50.044537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1188/2376] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:05:49 2022] PUT /identity/v3/projects/92f0bf6087744ed1bdf5be62c6a8cb7b/users/991a168fa75e44889c69a2927ba66250/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:05:50.057497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.057784 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.058056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.069229 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e571e-49ec-4b0a-83dc-8de102b36922 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.108570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] MFA Rules not processed for user `991a168fa75e44889c69a2927ba66250`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:50.108570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:50.180626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.182396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.182509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.182716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.192120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:50.240061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1189/2377] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:05:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:50.245510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:50.301773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:50.303476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:50.314292 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1189/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:05:50.339623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672668-f986-4bf8-b4d6-6c06bd5682e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.344939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.345716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.346117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.346494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.347243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:50.349594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:50.364039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:50.452730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1190/2379] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:05:50 2022] POST /identity/v3/projects => generated 355 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:05:50.456575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:50.498051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ff345-38a6-451d-882d-8e41dca0b540 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.616426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.621538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.621538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.621538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.621538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:50.621538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:50.707957 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1190/2380] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:05:50 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:05:50.711906 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:50.732868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b779a-e0ec-4975-9192-958dca4f7535 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.739085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.739724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.740108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.740390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.741071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:50.743546 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:50.760576 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:50.773385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1191/2381] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:05:50.778958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c286cb7-f57e-4da0-aa1a-4bb8b5de07b0 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.784343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.785147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.785508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.785858 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] PATH_INFO: `/v3/projects/0762251eb5c24216b1caebe6ebfa120c/users/44be639631b74eb484eb2b190f6581ac/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.815690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0762251eb5c24216b1caebe6ebfa120c, user_id=44be639631b74eb484eb2b190f6581ac, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:50.821784 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:50.896811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:50.903663 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1191/2382] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:05:50 2022] PUT /identity/v3/projects/0762251eb5c24216b1caebe6ebfa120c/users/44be639631b74eb484eb2b190f6581ac/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:05:50.907455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:50.921979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0539897-e3bf-4d77-ac17-e06f6cea2da6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:50.996841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:50.997649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:50.998069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:50.998441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:50.999287 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:51.001449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec6618-c564-43e9-a31d-0938b5ef9588 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:51.027876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1192/2383] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:05:51.029162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:51.041372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ebc7d-9c87-46de-8ffa-d1e441674735 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:51.049061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:51.049811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:51.050160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:51.050502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] PATH_INFO: `/v3/projects/0762251eb5c24216b1caebe6ebfa120c/users/44be639631b74eb484eb2b190f6581ac/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:51.054515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0762251eb5c24216b1caebe6ebfa120c, user_id=44be639631b74eb484eb2b190f6581ac, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:51.058973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:51.092949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1192/2384] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:05:51 2022] PUT /identity/v3/projects/0762251eb5c24216b1caebe6ebfa120c/users/44be639631b74eb484eb2b190f6581ac/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:05:51.095645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:51.096187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:51.096381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:51.148848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] MFA Rules not processed for user `44be639631b74eb484eb2b190f6581ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:05:51.150118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:51.237975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1193/2385] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:05:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:05:51.249638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:51.251802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:51.339566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09aef69-8886-4d04-be33-ac22acc17507 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:51.344777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:51.345660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:51.346089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:51.346440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:51.357799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:51.359341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:51.379058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1193/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:51.549095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:51.560085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4497d-425b-4725-bfa8-0da476efebf6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:51.565441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:51.565441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:51.565441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:51.565441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:51.643639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:51.645796 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194efb3-e426-4269-ac00-fd7d8f9a9763 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:51.652110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:05:51.657421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1194/2387] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:05:58.314454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:05:58.315969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:58.380243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8c077-00e1-44f5-83ea-85024f8c35de service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:05:58.383958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:05:58.384591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:05:58.384875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:05:58.385182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:05:58.387001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:05:58.406671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:05:58.408312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:05:58.418690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1194/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:01.612190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:01.613107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:01.613818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:01.635969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:01.637466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:01.694076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1195/2389] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:06:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:01.710569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:01.710569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:01.782304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d355e-1b8d-4a61-a5a5-d25fab890930 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:01.787594 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:01.788248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:01.788529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:01.788825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:01.798626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:01.800295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:01.808688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1195/2390] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:06:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:06:03.116425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:03.126305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d90cb-c94e-4d82-8e07-7c0ff3cba93a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:03.130163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:03.130771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:03.131158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:03.131832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:03.133773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:03.143650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:03.145123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:03.154252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1196/2391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:06.826007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:06.828469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:06.887970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:06.920387 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:06.953511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7c60f-ae0a-4595-a1ae-6886bf90c309 service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:06.959367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:06.960217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:06.961124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:06.961591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] PATH_INFO: `/v3/users/f3601003a5ca4b40a4c25ff3c4b3f712` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:06.962746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3601003a5ca4b40a4c25ff3c4b3f712)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:06.964720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:07.010824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9833fb0-cb23-4411-b601-393042c09a16 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:07.037739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:07.038578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:07.038946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:07.039609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:07.043399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:07.056446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:07.058105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:07.076187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1197/2392] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:07.188193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3601003a5ca4b40a4c25ff3c4b3f712'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:07.265527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3601003a5ca4b40a4c25ff3c4b3f712'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:07.266266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3601003a5ca4b40a4c25ff3c4b3f712'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:07.266997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3601003a5ca4b40a4c25ff3c4b3f712'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:07.277091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a7529410-cc92-4379-a4d8-f752d6c8f34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3601003a5ca4b40a4c25ff3c4b3f712'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:07.299465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1196/2393] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:06 2022] DELETE /identity/v3/users/f3601003a5ca4b40a4c25ff3c4b3f712 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:07.936354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:07.974148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a541865-7a97-4593-b64c-eb4b34bedbd4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.091596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.092925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.093213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.093495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] PATH_INFO: `/v3/projects/d2c126e659e5481884c6849bba013764` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.095771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c126e659e5481884c6849bba013764)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.098606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.123274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:08.218228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c126e659e5481884c6849bba013764', 'request_id': 'req-72179d1e-b672-4ecb-b806-d3c4b490cbc9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:08.226903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c126e659e5481884c6849bba013764', 'request_id': 'req-72179d1e-b672-4ecb-b806-d3c4b490cbc9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:08.299751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c126e659e5481884c6849bba013764', 'request_id': 'req-72179d1e-b672-4ecb-b806-d3c4b490cbc9'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:08.312745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] The token cache is being invalidate because project d2c126e659e5481884c6849bba013764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:08.313218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:08.314025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-72179d1e-b672-4ecb-b806-d3c4b490cbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:08.315972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1198/2394] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:07 2022] DELETE /identity/v3/projects/d2c126e659e5481884c6849bba013764 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:08.323356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.323881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.324034 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.343960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:08.345176 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:08.405273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1197/2395] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:08.413169 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.413461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.413735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.433138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:08.434308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:08.442063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1199/2396] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:08.447092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.457266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b6b38-54c6-4529-8129-74c72bf4010c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.462956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.463563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.463876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.464182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.464835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:08.465142 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.466744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.478537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1198/2397] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:06:08.482943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.492109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126c46a-53f6-4cbe-bf19-1ed4d22b42f3 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.497110 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.500046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.500046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.500046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.500046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.500911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.612749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1200/2398] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:08 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:08.614116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.624981 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b6c1f-c3fa-45a6-8a89-bb6c22c1a4ec admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.652477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:08.687168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.687168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.687168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.687535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.687984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.689943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.767767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1199/2399] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:08 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:08.777053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.787525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd204-b42b-4947-b061-13bc0e6cd5ad admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.792329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.807600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1201/2400] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:08.810355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.821098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6c2c8-11bf-4770-bf05-bc65975e3d5c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.826104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.826783 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.827129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.827472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.828215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.829869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490aea1f-3dee-4111-8828-0b501ce05666 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.843782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1200/2401] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:08.844964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:08.854958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6052f81a-ad3e-4dc7-b4af-86f85353a174 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:08.859572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:08.860271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.860550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.860841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] PATH_INFO: `/v3/projects/7336d8cfdc7e493a9f4a5a98280aa8df/users/29f6aea4e739497f8ce715dd725a1047/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.875971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7336d8cfdc7e493a9f4a5a98280aa8df, user_id=29f6aea4e739497f8ce715dd725a1047, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:08.878646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:08.952067 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1202/2402] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:08 2022] PUT /identity/v3/projects/7336d8cfdc7e493a9f4a5a98280aa8df/users/29f6aea4e739497f8ce715dd725a1047/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:08.963697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:08.964041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:08.964318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:08.996675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] MFA Rules not processed for user `29f6aea4e739497f8ce715dd725a1047`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:08.998124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:09.066290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1201/2403] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:09.082048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:09.082048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:09.147124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d017e24-b125-4f86-a0d9-403a019f6d43 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:09.151189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:09.151806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:09.152145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:09.156423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:09.162078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:09.164055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ba36f-8ab1-487b-97b6-ccd92db1ff9b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:09.173666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1203/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:09.196896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:09.263709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657427-18ab-4d93-a4fe-49c9571a784d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:09.268488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:09.271509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:09.271509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:09.271509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] PATH_INFO: `/v3/users/29f6aea4e739497f8ce715dd725a1047` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:09.271509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f6aea4e739497f8ce715dd725a1047)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:09.272850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:09.455646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:09.461999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f6aea4e739497f8ce715dd725a1047'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:09.561514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f6aea4e739497f8ce715dd725a1047'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:09.562281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f6aea4e739497f8ce715dd725a1047'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:09.562910 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f6aea4e739497f8ce715dd725a1047'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:09.570984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f6aea4e739497f8ce715dd725a1047'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:09.591754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1202/2405] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:09 2022] DELETE /identity/v3/users/29f6aea4e739497f8ce715dd725a1047 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:09.596450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:09.596733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:09.597059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:09.616698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:09.617938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:09.660085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:09.678992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1204/2406] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:09.694095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:09.695561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:09.756440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181c9fe-d781-4049-af2a-dea64fd83ad7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:09.760584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:09.761275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:09.761556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:09.761832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:09.771814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:09.773893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:09.783716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1203/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:10.403585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:10.405091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:10.417587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a9d2-6fc5-4270-a4f4-d2a741a42916 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:10.422895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:10.423754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.424087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.424370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] PATH_INFO: `/v3/projects/7336d8cfdc7e493a9f4a5a98280aa8df` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.425501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7336d8cfdc7e493a9f4a5a98280aa8df)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:10.427413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:10.585098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7336d8cfdc7e493a9f4a5a98280aa8df', 'request_id': 'req-79566660-9662-4c5d-8e5f-dd865ef1a2da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.591033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7336d8cfdc7e493a9f4a5a98280aa8df', 'request_id': 'req-79566660-9662-4c5d-8e5f-dd865ef1a2da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.673108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:10.674537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:10.687439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7336d8cfdc7e493a9f4a5a98280aa8df', 'request_id': 'req-79566660-9662-4c5d-8e5f-dd865ef1a2da'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.687729 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103081fa-9e61-4cb1-a735-2abcdf6decee service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:10.699182 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] The token cache is being invalidate because project 7336d8cfdc7e493a9f4a5a98280aa8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:10.699495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.700159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-79566660-9662-4c5d-8e5f-dd865ef1a2da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.701632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1205/2408] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:10 2022] DELETE /identity/v3/projects/7336d8cfdc7e493a9f4a5a98280aa8df => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:10.706292 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be61e-0b42-4443-9231-e0e5bd6ab664 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.706574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be61e-0b42-4443-9231-e0e5bd6ab664 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.706844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681be61e-0b42-4443-9231-e0e5bd6ab664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.727575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-681be61e-0b42-4443-9231-e0e5bd6ab664 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:10.728823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-681be61e-0b42-4443-9231-e0e5bd6ab664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:10.748894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:10.749529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.749807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.750078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] PATH_INFO: `/v3/users/991a168fa75e44889c69a2927ba66250` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.751270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] RBAC: Authorizing `identity:delete_user(user_id=991a168fa75e44889c69a2927ba66250)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:10.753220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:10.787685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1206/2409] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:10.795740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.796066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.796348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.815574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:10.817748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:10.824851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1207/2410] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:10.828665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:10.837999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90cd103-a6ac-42bb-82e1-b1934266edfd None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:10.842821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:10.843394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.843671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.843970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.846418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:10.846418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:10.846645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:10.858526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1208/2411] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:10.862531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:10.871873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03cb2b-25f7-4ca3-aa7b-d99af8510eff admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:10.876495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:10.877064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:10.877349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:10.877617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:10.878224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:10.880113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:10.940736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991a168fa75e44889c69a2927ba66250'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:10.952300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1209/2412] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:10 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:10.956575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:10.986573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:11.002004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991a168fa75e44889c69a2927ba66250'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.002633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991a168fa75e44889c69a2927ba66250'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.003241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991a168fa75e44889c69a2927ba66250'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.009263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:11.011218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b030b837-58de-48be-893b-dc9c0b8cb97a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991a168fa75e44889c69a2927ba66250'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.016945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9921b-b17d-43f6-ae85-01d1853f7b94 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.022464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.023648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.024426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.024878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.025926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.028107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.029035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1204/2413] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:10 2022] DELETE /identity/v3/users/991a168fa75e44889c69a2927ba66250 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:11.033485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.033775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.034052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.053482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:11.054661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:11.103234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1210/2414] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:10 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:11.104639 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.106800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:11.112813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1205/2415] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:11.119913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07890a9-be13-4780-8786-3a706184d37d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.122544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.127280 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:11.127454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.127454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.127454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.127454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.128078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.129811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.141247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1211/2416] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:11.145136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.155125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea93f8-e116-4fff-b683-68b1d274a8fc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.160844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.161674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.162177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.162857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.164141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.167424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.176034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1212/2417] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:11.180161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.186838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a446f7-638b-4121-95a8-470e739ce5ab None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.189780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9940fdc-66b6-4481-90f7-858e846aa0e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.190589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.191145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.191426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.191700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.194510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.195161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.195437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.195709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] PATH_INFO: `/v3/projects/96f94a1b77134e84807df4495272b3ad/users/4608fa0bbc114c0bb0ea3e6240faaed7/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.202003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.203488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148310fe-910e-49ef-906f-5bd783472227 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.211020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96f94a1b77134e84807df4495272b3ad, user_id=4608fa0bbc114c0bb0ea3e6240faaed7, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.213895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.214014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1206/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:11.358429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1213/2419] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:11 2022] PUT /identity/v3/projects/96f94a1b77134e84807df4495272b3ad/users/4608fa0bbc114c0bb0ea3e6240faaed7/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:11.363620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.363926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.364216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.397246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:11.399048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:11.474399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1207/2420] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:11.495048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.557888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dace5-94f4-48d0-a81b-4f1e1092af6f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.562230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.562376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.562603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.562872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.593707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.595471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.607273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1214/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:11.746993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:11.748575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:11.761539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80282431-7493-4448-bd45-5475bbd48c74 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:11.768076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:11.770165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:11.770165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:11.770165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] PATH_INFO: `/v3/projects/92f0bf6087744ed1bdf5be62c6a8cb7b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:11.771437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f0bf6087744ed1bdf5be62c6a8cb7b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:11.774269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:11.794082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:11.887538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f0bf6087744ed1bdf5be62c6a8cb7b', 'request_id': 'req-5ed48667-c493-441e-b172-638867de6220'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.958782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f0bf6087744ed1bdf5be62c6a8cb7b', 'request_id': 'req-5ed48667-c493-441e-b172-638867de6220'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.968368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f0bf6087744ed1bdf5be62c6a8cb7b', 'request_id': 'req-5ed48667-c493-441e-b172-638867de6220'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.983787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] The token cache is being invalidate because project 92f0bf6087744ed1bdf5be62c6a8cb7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:11.984262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.985493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:11.987312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1208/2422] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:11 2022] DELETE /identity/v3/projects/92f0bf6087744ed1bdf5be62c6a8cb7b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:11.992265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:12.003038 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca5cd79-835d-473c-92dc-9ab15a1e1c78 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:12.060368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:12.061013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:12.061316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:12.061590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] PATH_INFO: `/v3/users/44be639631b74eb484eb2b190f6581ac` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:12.062720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=44be639631b74eb484eb2b190f6581ac)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:12.064716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:12.080766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:12.285328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44be639631b74eb484eb2b190f6581ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:12.373773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44be639631b74eb484eb2b190f6581ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:12.374370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44be639631b74eb484eb2b190f6581ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:12.375021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44be639631b74eb484eb2b190f6581ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:12.383031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-fb315569-854a-43f9-9db8-31ff1a09bbcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44be639631b74eb484eb2b190f6581ac'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:12.409342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1215/2423] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:11 2022] DELETE /identity/v3/users/44be639631b74eb484eb2b190f6581ac => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:12.928893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:12.931002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:12.944730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed48667-c493-441e-b172-638867de6220 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.005125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.005762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.006038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.006311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] PATH_INFO: `/v3/projects/0762251eb5c24216b1caebe6ebfa120c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.007512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0762251eb5c24216b1caebe6ebfa120c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.009676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.065749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.066249 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.066412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.106014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] MFA Rules not processed for user `4608fa0bbc114c0bb0ea3e6240faaed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:13.107233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.153657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0762251eb5c24216b1caebe6ebfa120c', 'request_id': 'req-f1050c9d-7e82-4941-8084-cfde224d3b57'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:13.180101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1216/2424] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:13.188400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.189792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.213373 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0762251eb5c24216b1caebe6ebfa120c', 'request_id': 'req-f1050c9d-7e82-4941-8084-cfde224d3b57'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:13.221477 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0762251eb5c24216b1caebe6ebfa120c', 'request_id': 'req-f1050c9d-7e82-4941-8084-cfde224d3b57'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:13.235306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] The token cache is being invalidate because project 0762251eb5c24216b1caebe6ebfa120c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:13.235719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:13.236473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1050c9d-7e82-4941-8084-cfde224d3b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:13.238070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1209/2425] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:12 2022] DELETE /identity/v3/projects/0762251eb5c24216b1caebe6ebfa120c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:13.242805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb975f2-21ac-4cb1-8b4e-aff38696a920 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.243305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb975f2-21ac-4cb1-8b4e-aff38696a920 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.243584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb975f2-21ac-4cb1-8b4e-aff38696a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.257086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ccc2a-bbbd-496d-a1ef-575ec17e3418 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.263773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4cb975f2-21ac-4cb1-8b4e-aff38696a920 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:13.265793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4cb975f2-21ac-4cb1-8b4e-aff38696a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.298202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:13.301845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:13.312622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.313236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.313516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.313792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.315738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.326850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1210/2426] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:13.336548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.336921 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.337199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.357779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:13.358975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.367259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1211/2427] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:13.371511 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.378211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.380018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.381172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a4d48-bfc3-4b87-937b-3a32a20db765 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.385855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.386452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.386728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.390873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.390873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:13.390873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.390873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.391311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1217/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:13.403508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1212/2429] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:13.407773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.419023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ea530-0792-4313-b797-224da3f13712 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.423767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.424474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.424770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.425017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.425652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.427563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.504335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1218/2430] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:13.505452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.517506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85b5b5-0999-459c-810f-d0f2bb92c2c5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.575683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.576323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.576608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.576881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.577502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.579452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.653717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1213/2431] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:13.657826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.669137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6be6aa-f70f-4b80-9b35-a0b741cabfc4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.673777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.674385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.674668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.674945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.675584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.677409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.689736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1219/2432] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:13.693905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.704682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fb877-82cc-4d11-9b84-b11650b71f43 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.709196 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.715753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.715753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.715753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.715753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.715753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da506b8-7e07-44dc-94aa-1a96abd5eec4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.724179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1214/2433] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:13.728229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:13.738348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b70433-f6ac-48b1-8db9-f1333406e28b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:13.743999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:13.744177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.744463 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.744735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] PATH_INFO: `/v3/projects/7e34cfa39bb94203875c9b514b9cf661/users/1cd05a4d4d6d49f7991f0544201a21f2/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.759867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e34cfa39bb94203875c9b514b9cf661, user_id=1cd05a4d4d6d49f7991f0544201a21f2, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:13.762626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:13.836632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1220/2434] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:13 2022] PUT /identity/v3/projects/7e34cfa39bb94203875c9b514b9cf661/users/1cd05a4d4d6d49f7991f0544201a21f2/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:13.847047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:13.847417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:13.848290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:13.883201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] MFA Rules not processed for user `1cd05a4d4d6d49f7991f0544201a21f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:13.884565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:13.973028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1215/2435] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:13.974827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.001727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.003396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.038819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:14.064982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce63737-75f4-4a64-b462-48a3bb2aa4bc admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.070561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.082365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.082365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.082365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.082365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.082365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.096724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ac846-bf98-4983-b38f-2c0afaf7d30c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.102435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.103236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.103461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.106993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.106993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.122528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.124513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.147537 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1216/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:14.200814 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1221/2437] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:13 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:14.212425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.232624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0545ea-083c-43f8-aae5-c5d0ea0e6393 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.240459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.242956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.274164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:14.298782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.299449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.299854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.300182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.300853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.302938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.308636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dde1ed-b605-42c9-8cf1-c3a6bb6b62cb admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.312701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.315843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.315843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.315843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.315843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.329363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.330781 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.340606 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1222/2438] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:14.431230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1217/2439] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:14 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:14.432822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.443154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068d41f-b0aa-4d21-959f-5d9cfc74f4ad service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.449613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.454097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.454097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.454097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.454097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.454496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.476510 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1223/2440] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:14.477401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.488420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e27b3-d38f-4688-9b48-0a30c44fc97f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.494988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.495789 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.496174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.496526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] PATH_INFO: `/v3/projects/deffa163991948c1a918a52a5f506549/users/ba15f4f052a0451e84e88f8b4d80154e/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.513101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deffa163991948c1a918a52a5f506549, user_id=ba15f4f052a0451e84e88f8b4d80154e, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.516206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.609213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1218/2441] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:14 2022] PUT /identity/v3/projects/deffa163991948c1a918a52a5f506549/users/ba15f4f052a0451e84e88f8b4d80154e/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:14.613330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.623409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7bb90-53a6-465f-9dab-df2db906b370 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.685674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.686454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.686813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.687159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.687899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.689612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b021c9-142b-43f0-b7f6-84f9cc3ffe4a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.699793 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1224/2442] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:14.704740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.715739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66178259-8ee2-45ab-9e6e-4d890e6e8140 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.720374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.721044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.721324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.721596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] PATH_INFO: `/v3/projects/deffa163991948c1a918a52a5f506549/users/ba15f4f052a0451e84e88f8b4d80154e/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.723551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deffa163991948c1a918a52a5f506549, user_id=ba15f4f052a0451e84e88f8b4d80154e, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.726922 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.737658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1219/2443] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:14 2022] PUT /identity/v3/projects/deffa163991948c1a918a52a5f506549/users/ba15f4f052a0451e84e88f8b4d80154e/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:14.747940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092eb18-a838-4a9c-9fa4-1e0db5439e1e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.748243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092eb18-a838-4a9c-9fa4-1e0db5439e1e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.748521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092eb18-a838-4a9c-9fa4-1e0db5439e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.776961 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5092eb18-a838-4a9c-9fa4-1e0db5439e1e None None] MFA Rules not processed for user `ba15f4f052a0451e84e88f8b4d80154e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:14.778225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5092eb18-a838-4a9c-9fa4-1e0db5439e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.848756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1225/2444] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:14.860602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:14.862263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:14.920267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872b267-c15a-42a3-8bc7-65472a3a63d3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:14.923960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:14.924580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:14.924862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:14.925134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:14.934801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:14.937872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:14.946363 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1220/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:15.160479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:15.160969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:15.161063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:15.198080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] MFA Rules not processed for user `4608fa0bbc114c0bb0ea3e6240faaed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:15.198080 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:15.205514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:15.211605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:15.214940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83008e80-93d9-439f-9178-6f5b2a5172b1 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:15.219124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:15.219721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:15.220234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:15.220504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:15.223105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:15.250521 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1226/2446] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:15.286078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:15.289408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:15.300738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1221/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:15.644883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:15.705864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7135-c8b9-446f-bc46-76e4fb90c4fe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:15.715467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:15.716139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:15.716409 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:15.716683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:15.718433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:15.729496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:15.730693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:15.743075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1227/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:18.801031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:18.803488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:18.888973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851bc7-52bb-4017-9259-6e47f8812169 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:18.893895 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:18.894601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:18.894884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:18.895306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] PATH_INFO: `/v3/users/bc7fd21870f94086a6a0325650a49d3f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:18.896489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7fd21870f94086a6a0325650a49d3f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:18.898467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:19.045525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7fd21870f94086a6a0325650a49d3f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.099300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7fd21870f94086a6a0325650a49d3f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.100187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7fd21870f94086a6a0325650a49d3f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.100919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7fd21870f94086a6a0325650a49d3f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.109426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bd6858c6-1f34-4e74-9119-b75d33f4652b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7fd21870f94086a6a0325650a49d3f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.130658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1222/2449] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:18 2022] DELETE /identity/v3/users/bc7fd21870f94086a6a0325650a49d3f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:19.391778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:19.404174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099a7fc-9ceb-41dc-9c81-083668863816 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:19.493512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:19.494272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:19.494626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:19.494974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] PATH_INFO: `/v3/projects/7c8e0d1aeb50401b85c2e2e3a0552ae2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:19.496448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8e0d1aeb50401b85c2e2e3a0552ae2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:19.498602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:19.612654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8e0d1aeb50401b85c2e2e3a0552ae2', 'request_id': 'req-06ae3213-59e2-4802-b200-09bb25ac74ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.619257 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8e0d1aeb50401b85c2e2e3a0552ae2', 'request_id': 'req-06ae3213-59e2-4802-b200-09bb25ac74ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.704929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8e0d1aeb50401b85c2e2e3a0552ae2', 'request_id': 'req-06ae3213-59e2-4802-b200-09bb25ac74ba'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.718044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] The token cache is being invalidate because project 7c8e0d1aeb50401b85c2e2e3a0552ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:19.718483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.719300 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-06ae3213-59e2-4802-b200-09bb25ac74ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:19.721352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1228/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:19 2022] DELETE /identity/v3/projects/7c8e0d1aeb50401b85c2e2e3a0552ae2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:19.726924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:19.727329 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:19.727665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:19.749283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:19.750455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:19.769415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:19.823055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1223/2451] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:19.831451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:19.832078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:19.832459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:19.854614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:19.856020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:19.863834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1229/2452] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:19.868519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:19.878539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c1a62-8f20-42ae-be97-d32bad50d750 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:19.883703 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:19.884348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:19.884625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:19.884892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:19.885534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:19.885940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:19.887769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:19.903428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1224/2453] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:06:19.907991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:19.919024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522cd48-888a-437e-8538-79ff6791ce15 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:19.934799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:19.936490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:19.936789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:19.937063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:19.940290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:19.942582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:19.948855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:20.039007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1230/2454] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:19 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:20.044282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.056029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f2948-0bed-45f2-b9fb-e676e2fc50c5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.117505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.118143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.118409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.118686 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.119359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.121382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.254026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1225/2455] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:20 2022] POST /identity/v3/users => generated 282 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:20.258573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.268766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc4179-a7aa-4e6f-ab29-163c6f8f30ec admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.273823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.274424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.274703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.274970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.275609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.277262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.286919 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1231/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:20.290881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.300827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f7213-e241-4b88-b57d-2464ee744b64 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.307778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.309311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.314095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.314095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.314095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.314095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79f5f2-1ff0-4fcc-b991-8f72334b68ef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.326482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1226/2457] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:20.330479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.342531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41d722-ee30-4a6a-8c02-398563de1752 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.346924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.347583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.347863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.348167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] PATH_INFO: `/v3/projects/b3e3bab5acb14f6ab479a656e87d0328/users/77a887c08dd94e4786468354f7124c52/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.365041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e3bab5acb14f6ab479a656e87d0328, user_id=77a887c08dd94e4786468354f7124c52, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.367821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.471993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1232/2458] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:20 2022] PUT /identity/v3/projects/b3e3bab5acb14f6ab479a656e87d0328/users/77a887c08dd94e4786468354f7124c52/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:20.482579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.482871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.483144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.511767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] MFA Rules not processed for user `77a887c08dd94e4786468354f7124c52`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:20.513104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:20.579994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1227/2459] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:20.584681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.649868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6460c0-009e-44a0-b2ed-7982a57150ac admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.654512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.655130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.655412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.655686 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.656462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.658533 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.744235 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1233/2460] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:20 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:20.745712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.756992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a42fb-6729-4b8e-9e6f-ba39c035bb19 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.770628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:20.825202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.826099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.826581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.826960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.827716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.829860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.908390 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1228/2461] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:20 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:20.912711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.924065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015664f2-d4ac-43a2-9f44-7724f6508d1e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.929566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.930272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.930553 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.930734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.931373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.933098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:20.945370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1234/2462] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:20.951252 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:20.961525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd93b2-23f2-4959-a08d-96d05444d798 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:20.966185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:20.966853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:20.967147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:20.967415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] PATH_INFO: `/v3/projects/7d79651a6388416db1df807c20a5d84e/users/2205e2fcf8d54ae8b6ac6a7366d72389/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:20.982694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d79651a6388416db1df807c20a5d84e, user_id=2205e2fcf8d54ae8b6ac6a7366d72389, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:20.985403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:21.055433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1229/2463] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:20 2022] PUT /identity/v3/projects/7d79651a6388416db1df807c20a5d84e/users/2205e2fcf8d54ae8b6ac6a7366d72389/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:21.059400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:21.070918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56ff79-c972-43d5-a81d-3f3bc5650454 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:21.132868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:21.133494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:21.133790 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:21.134662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:21.134937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:21.143424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40b118-bccd-418c-b979-99e716392c4f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:21.148381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1235/2464] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:21.156515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:21.168031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a25407-8efa-4734-a55d-1f1529a8c319 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:21.172855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:21.173515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:21.173795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:21.174072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] PATH_INFO: `/v3/projects/7d79651a6388416db1df807c20a5d84e/users/2205e2fcf8d54ae8b6ac6a7366d72389/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:21.176028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d79651a6388416db1df807c20a5d84e, user_id=2205e2fcf8d54ae8b6ac6a7366d72389, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:21.180461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:21.189777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1230/2465] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:21 2022] PUT /identity/v3/projects/7d79651a6388416db1df807c20a5d84e/users/2205e2fcf8d54ae8b6ac6a7366d72389/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:21.201863 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a898-327f-4041-a907-6443fac140dc None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:21.202148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a898-327f-4041-a907-6443fac140dc None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:21.202418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a898-327f-4041-a907-6443fac140dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:21.241039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ca00a898-327f-4041-a907-6443fac140dc None None] MFA Rules not processed for user `2205e2fcf8d54ae8b6ac6a7366d72389`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:21.241039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca00a898-327f-4041-a907-6443fac140dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:21.243142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:21.307550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1236/2466] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:21.318830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:21.320568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:21.378940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbab15-75d4-48d5-a7c6-0e02520115de admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:21.388495 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:21.389129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:21.389415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:21.389693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:21.399123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:21.400639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:21.410129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1231/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:21.610256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a898-327f-4041-a907-6443fac140dc None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:21.611744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ca00a898-327f-4041-a907-6443fac140dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:21.624243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a898-327f-4041-a907-6443fac140dc None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:21.627789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:21.628419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:21.628698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:21.628970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:21.684213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:21.685654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd53f0-eb9b-4eca-a876-b0cff2ce51f9 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:21.694650 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1237/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:24.337865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:24.340044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:24.406868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf67a0-3dc3-4b2b-a499-332266dbcbed service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:24.411470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:24.412147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:24.412435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:24.412761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] PATH_INFO: `/v3/users/1cd05a4d4d6d49f7991f0544201a21f2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:24.414451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd05a4d4d6d49f7991f0544201a21f2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:24.416431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:24.438009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:24.581072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd05a4d4d6d49f7991f0544201a21f2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:24.630118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd05a4d4d6d49f7991f0544201a21f2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:24.630740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd05a4d4d6d49f7991f0544201a21f2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:24.631338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd05a4d4d6d49f7991f0544201a21f2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:24.638510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd05a4d4d6d49f7991f0544201a21f2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:24.656356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1232/2469] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:24 2022] DELETE /identity/v3/users/1cd05a4d4d6d49f7991f0544201a21f2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:24.661157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3434-3d45-41c9-8622-754493ff250b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:24.661646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3434-3d45-41c9-8622-754493ff250b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:24.661749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e3434-3d45-41c9-8622-754493ff250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:24.680670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-605e3434-3d45-41c9-8622-754493ff250b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:24.681856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-605e3434-3d45-41c9-8622-754493ff250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:24.739324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1238/2470] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:24.748947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:24.750515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:24.807253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20030a3-b2c9-44fa-8328-e82b99d5b385 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:24.810837 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:24.811437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:24.811715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:24.812017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:24.821312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:24.823005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:24.832151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1233/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:25.261237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3434-3d45-41c9-8622-754493ff250b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:25.262730 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-605e3434-3d45-41c9-8622-754493ff250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:25.320951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e3434-3d45-41c9-8622-754493ff250b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:25.320951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:25.320951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:25.320951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:25.322294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] PATH_INFO: `/v3/projects/7e34cfa39bb94203875c9b514b9cf661` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:25.322294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e34cfa39bb94203875c9b514b9cf661)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:25.322294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:25.364314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:25.365716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:25.378650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be7a89-1fb5-4d44-82fc-1dd2b31340c6 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:25.383905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:25.384560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:25.384864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:25.385135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] PATH_INFO: `/v3/users/77a887c08dd94e4786468354f7124c52` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:25.386234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a887c08dd94e4786468354f7124c52)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:25.388182 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:25.403673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:25.410666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e34cfa39bb94203875c9b514b9cf661', 'request_id': 'req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.416258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e34cfa39bb94203875c9b514b9cf661', 'request_id': 'req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.498813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e34cfa39bb94203875c9b514b9cf661', 'request_id': 'req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.510514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] The token cache is being invalidate because project 7e34cfa39bb94203875c9b514b9cf661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:25.510809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.511453 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.513475 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1239/2472] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:25 2022] DELETE /identity/v3/projects/7e34cfa39bb94203875c9b514b9cf661 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:25.516768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:25.518202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:25.578019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a887c08dd94e4786468354f7124c52'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.589829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ee25e-1c9d-4ef2-84d9-357e6c5e842b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:25.595966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:25.595966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:25.595966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:25.596346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] PATH_INFO: `/v3/users/ba15f4f052a0451e84e88f8b4d80154e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:25.597146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba15f4f052a0451e84e88f8b4d80154e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:25.599052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:25.636105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a887c08dd94e4786468354f7124c52'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.636735 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a887c08dd94e4786468354f7124c52'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.637344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a887c08dd94e4786468354f7124c52'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.645266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e6986b0-4082-4435-871a-4054daab4d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a887c08dd94e4786468354f7124c52'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.663100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1234/2473] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:25 2022] DELETE /identity/v3/users/77a887c08dd94e4786468354f7124c52 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:25.668010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:25.668305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:25.668607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:25.682235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:25.773259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba15f4f052a0451e84e88f8b4d80154e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.810149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:25.811480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:25.869615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1235/2474] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:25.869918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba15f4f052a0451e84e88f8b4d80154e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.870351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba15f4f052a0451e84e88f8b4d80154e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.871005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba15f4f052a0451e84e88f8b4d80154e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.878957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba15f4f052a0451e84e88f8b4d80154e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:25.879165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:25.880722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:25.896992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1240/2475] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:25 2022] DELETE /identity/v3/users/ba15f4f052a0451e84e88f8b4d80154e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:25.942068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95723b5c-dfde-4cd8-94c4-3bc7ac0d2490 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:25.997878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:25.998493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:25.998771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:25.999041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.000960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.071123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.071123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.078021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1236/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:26.385095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.385972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.408369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14aa3f1-71a2-422f-8294-e6bc74110e4a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.413087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.413772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.414056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.414332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] PATH_INFO: `/v3/projects/deffa163991948c1a918a52a5f506549` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.415618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=deffa163991948c1a918a52a5f506549)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.417775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.530128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:26.541091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deffa163991948c1a918a52a5f506549', 'request_id': 'req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.542308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.543836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.555662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deffa163991948c1a918a52a5f506549', 'request_id': 'req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.557533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f227f8-395b-4a3f-aab4-f2491f54535d service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.567736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:26.602141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deffa163991948c1a918a52a5f506549', 'request_id': 'req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.616438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] The token cache is being invalidate because project deffa163991948c1a918a52a5f506549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:26.617250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.621055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-af67f1b2-0dea-488e-9e9c-3ed9156e80cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.621055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1241/2477] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:26 2022] DELETE /identity/v3/projects/deffa163991948c1a918a52a5f506549 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:26.621308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.621606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.621961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.622251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] PATH_INFO: `/v3/projects/b3e3bab5acb14f6ab479a656e87d0328` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.623542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e3bab5acb14f6ab479a656e87d0328)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.624541 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1277-23de-4166-990d-d5ce07e87114 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.624799 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1277-23de-4166-990d-d5ce07e87114 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.625102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b1277-23de-4166-990d-d5ce07e87114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.625498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.646497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d43b1277-23de-4166-990d-d5ce07e87114 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:26.647721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d43b1277-23de-4166-990d-d5ce07e87114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.656544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1242/2478] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:26.665245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.665530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.665803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.685491 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:26.686788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.695875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1243/2479] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:26.700041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.709213 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee86ec-383d-4281-9802-3549a017c206 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.713913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.714504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.714895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.715079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.715838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:26.716171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.717758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.730523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1244/2480] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:26.734826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.740890 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e3bab5acb14f6ab479a656e87d0328', 'request_id': 'req-0d04c04a-60e5-4f06-8195-5a2deca2a676'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.746979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5a12c-211e-4a7a-af00-3dc73075d0e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.791420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e3bab5acb14f6ab479a656e87d0328', 'request_id': 'req-0d04c04a-60e5-4f06-8195-5a2deca2a676'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.797962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e3bab5acb14f6ab479a656e87d0328', 'request_id': 'req-0d04c04a-60e5-4f06-8195-5a2deca2a676'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.809316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.810106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.810274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.810549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.811224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.811411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] The token cache is being invalidate because project b3e3bab5acb14f6ab479a656e87d0328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:26.811711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.812389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:26.814673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.814799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1237/2481] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:26 2022] DELETE /identity/v3/projects/b3e3bab5acb14f6ab479a656e87d0328 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:26.818180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.819822 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.834931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04c04a-60e5-4f06-8195-5a2deca2a676 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.840023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.840801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.841175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.841546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] PATH_INFO: `/v3/users/2205e2fcf8d54ae8b6ac6a7366d72389` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.842812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2205e2fcf8d54ae8b6ac6a7366d72389)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.844958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:26.895060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1245/2482] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:26 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:26.899127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:26.900869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:26.964335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f87f4-cf08-4459-881d-e87708f24c43 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:26.969219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:26.969834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:26.970120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:26.970393 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:26.971031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:26.973053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.020848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2205e2fcf8d54ae8b6ac6a7366d72389'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.092928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1246/2483] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:26 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:27.097042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.107066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2168765-c9cf-4e82-bfe3-25e88d661bab admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.111663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.112271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.112552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.112817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.113439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.115392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.116093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2205e2fcf8d54ae8b6ac6a7366d72389'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.117513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2205e2fcf8d54ae8b6ac6a7366d72389'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.118156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2205e2fcf8d54ae8b6ac6a7366d72389'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.125776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2205e2fcf8d54ae8b6ac6a7366d72389'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.127014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1247/2484] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:27.130868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.132539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.144975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400f013-64d9-4ab3-8bad-1c836643957f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.146615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1238/2485] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:26 2022] DELETE /identity/v3/users/2205e2fcf8d54ae8b6ac6a7366d72389 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:27.151441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:27.211042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.212076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.212691 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.213246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.214116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.216379 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba68f62-417b-4ead-bb72-27c692ea7ca4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.229022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1248/2486] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:27.233796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.244643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258566b-df7a-49f4-966e-3ed618ec6952 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.249457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.250109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.250388 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.250662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] PATH_INFO: `/v3/projects/421da927e80d446e8e4e86a14e02a13d/users/f87a1c5294984b06bf35bf3742b50008/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.263027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:27.266091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421da927e80d446e8e4e86a14e02a13d, user_id=f87a1c5294984b06bf35bf3742b50008, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.268828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.341150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1239/2487] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:27 2022] PUT /identity/v3/projects/421da927e80d446e8e4e86a14e02a13d/users/f87a1c5294984b06bf35bf3742b50008/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:27.352461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.352767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.353026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.382926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] MFA Rules not processed for user `f87a1c5294984b06bf35bf3742b50008`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:27.384316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.448897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1249/2488] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:27.453601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.518337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadd43a-849c-4357-b690-53459444d053 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.523425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.524054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.524332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.524602 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.525227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.527115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.557718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.559117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.578519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4158c-6216-425c-aac7-e1c60c0d56e2 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.583327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.584611 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.584945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.585092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] PATH_INFO: `/v3/projects/7d79651a6388416db1df807c20a5d84e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.586860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d79651a6388416db1df807c20a5d84e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.588937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.614312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1240/2489] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:27 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:27.617994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.677581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bd04-dfb4-4ec2-ad27-1f880e3363a5 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.682032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.682627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.682904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.683173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.683790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.685720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.717428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d79651a6388416db1df807c20a5d84e', 'request_id': 'req-d777d5b4-4d90-4123-bb29-0237f72e291e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.732671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d79651a6388416db1df807c20a5d84e', 'request_id': 'req-d777d5b4-4d90-4123-bb29-0237f72e291e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.802531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1241/2490] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:27 2022] POST /identity/v3/users => generated 307 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:27.806484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.807464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d79651a6388416db1df807c20a5d84e', 'request_id': 'req-d777d5b4-4d90-4123-bb29-0237f72e291e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.819304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] The token cache is being invalidate because project 7d79651a6388416db1df807c20a5d84e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:27.829238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.829238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d777d5b4-4d90-4123-bb29-0237f72e291e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:27.829238 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1250/2491] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:27 2022] DELETE /identity/v3/projects/7d79651a6388416db1df807c20a5d84e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:27.829700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2ca59-9f5e-44d1-b3cf-d02cc5d9af18 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.832962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cdc27-49c7-46b4-a444-2d05d51dcac2 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.833326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cdc27-49c7-46b4-a444-2d05d51dcac2 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.833669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cdc27-49c7-46b4-a444-2d05d51dcac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.854423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-306cdc27-49c7-46b4-a444-2d05d51dcac2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:27.855638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-306cdc27-49c7-46b4-a444-2d05d51dcac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.865374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:27.894365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.894985 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.895263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.895533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.896202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.898805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.909303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1242/2492] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:27.913971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.915556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.923664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:27.924401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1251/2493] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:27.932509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.932883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.933560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.934195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5867-2816-472a-bdd1-976469c84b04 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.939012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.942669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.942669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.942669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] PATH_INFO: `/v3/projects/443a3ee6d5f248f1afcbac30403fbb53/users/f32efa138bcb4bf893f7be0b0f5ab28f/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.955505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:27.956782 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:27.972091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1252/2494] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:27.973490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:27.975486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443a3ee6d5f248f1afcbac30403fbb53, user_id=f32efa138bcb4bf893f7be0b0f5ab28f, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.978463 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:27.986509 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9b1b9b-111b-4729-8b26-b636cb6ab5b0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:27.992006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:27.992614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:27.992900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:27.993179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:27.993829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:27.994132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:27.995804 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.008074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1253/2495] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:28.012438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.022036 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b52760-6a4f-4362-a265-7d93962b6edd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.027680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.028315 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.030579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.030579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.030579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.031571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.064665 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1243/2496] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:27 2022] PUT /identity/v3/projects/443a3ee6d5f248f1afcbac30403fbb53/users/f32efa138bcb4bf893f7be0b0f5ab28f/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:28.068649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.139943 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1603de5-d8bf-4610-be76-9c864e40bec6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.144743 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.145418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.145699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.147984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.147984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.148404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.161564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1244/2497] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:28.165726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.168312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1254/2498] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:28 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:28.172209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.180452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af221469-04ad-491e-9a31-4079da40faaa admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.245097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.245814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.246304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.246513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] PATH_INFO: `/v3/projects/443a3ee6d5f248f1afcbac30403fbb53/users/f32efa138bcb4bf893f7be0b0f5ab28f/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.249307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=443a3ee6d5f248f1afcbac30403fbb53, user_id=f32efa138bcb4bf893f7be0b0f5ab28f, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.252116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d357cfe-3acc-4304-b64d-eea0a9ecd6bc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.255731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d5ea-a5f4-4a3b-95e1-6bf2806e593a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.263203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.263821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.264130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.274094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1245/2499] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:28 2022] PUT /identity/v3/projects/443a3ee6d5f248f1afcbac30403fbb53/users/f32efa138bcb4bf893f7be0b0f5ab28f/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:28.274311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.274311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.274311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.276698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.277255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.277538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.309360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] MFA Rules not processed for user `f32efa138bcb4bf893f7be0b0f5ab28f`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:28.310742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:28.375416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:28.380772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1255/2500] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:28 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:28.386429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.389410 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1246/2501] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:28.398430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf69b61-bbdd-406e-8d82-773878df0602 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.402041 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.403955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:28.471872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.473066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.473175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31044205-6a24-4f5d-ae0c-4b841e4ed13a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.473285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.473285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.473769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.475831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.478112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.479021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.479468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.479958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.482259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:28.488467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1256/2502] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:28.493468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.495144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.496885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.505483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567795c-2656-4863-9505-c9d401e0caa9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.507360 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1247/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:28.511682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.512466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.512867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.513212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.514120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.515844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374569b-dbed-4dde-b50c-3524e7e0bbc4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.526791 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1257/2504] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:28.531297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.542523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe33fe4-72b9-40c2-98fc-9561005779a0 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.547812 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.548522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.550126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.550126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] PATH_INFO: `/v3/projects/94d1eadaf33d4f598382c270a52b6665/users/8b1eebf8a4b44305a7a81f31f365fdfc/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.566443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d1eadaf33d4f598382c270a52b6665, user_id=8b1eebf8a4b44305a7a81f31f365fdfc, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.570064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.637797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1248/2505] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:28 2022] PUT /identity/v3/projects/94d1eadaf33d4f598382c270a52b6665/users/8b1eebf8a4b44305a7a81f31f365fdfc/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:28.648020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.648312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.648575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.686748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.696071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] MFA Rules not processed for user `8b1eebf8a4b44305a7a81f31f365fdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:28.697612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:28.757244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bd294-ac73-488a-885d-88122c4a264c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.761705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.762849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.763254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.763969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.766573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:28.789995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1258/2506] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:28.794284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:28.840257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.841739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:28.854150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1249/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:28.875309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95315-fc13-44d4-a7a3-796a06f530e0 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:28.880071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:28.884528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:28.884850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:28.885139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:28.885807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:28.888591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.003159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1259/2508] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:28 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:29.007249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.017920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23421174-44d9-4cfd-abd9-8367c45edfc2 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.044291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:29.075800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.076437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.076721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.077027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.077624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.079530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.212662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1250/2509] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:29 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:29.213927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.224818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf988e-4e67-4448-ac0d-93910a26a722 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.229995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.230634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.230915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.231210 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.231856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.233497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.247099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1260/2510] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:29.248232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.259147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010b86-94c7-4fbe-ab0b-9550dfb83eff admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.263829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.264470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.264750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.265078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.265669 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.267272 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019a13-d281-4102-872c-17d8c6725713 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.280096 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1251/2511] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:29.282855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.292964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440659e-079a-49c4-a0e1-635989561b6c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.297887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.298549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.298836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.299113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] PATH_INFO: `/v3/projects/1762f1ff88464dd387a8e2eac08ae301/users/a55b259b8eea4a82b99d4c4a97efa6d9/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.315267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1762f1ff88464dd387a8e2eac08ae301, user_id=a55b259b8eea4a82b99d4c4a97efa6d9, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.318006 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.402482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1261/2512] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:29 2022] PUT /identity/v3/projects/1762f1ff88464dd387a8e2eac08ae301/users/a55b259b8eea4a82b99d4c4a97efa6d9/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:29.414312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.414596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.414869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.450268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] MFA Rules not processed for user `a55b259b8eea4a82b99d4c4a97efa6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:29.452241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:29.525758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1252/2513] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:29.530334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.569306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:29.602014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1359bc0-3289-4ead-bd30-8cf428f9b9b5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.607425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.608108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.608370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.614645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.614645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.614645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.714911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1262/2514] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:29 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:29.716306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.727744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb19b2-9d97-4e5a-a3d0-25b880b8815e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.786457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.787075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.787356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.787627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.788294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.790233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.887797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1253/2515] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:29 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:29.891835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.902163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0468d00-408d-41c3-87aa-3bc61f9c306d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.907158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.907830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.908137 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.908445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.909084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.910722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:29.920499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1263/2516] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:29.924780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:29.935219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36c43d-19e4-4fca-b5ee-3450b371c24f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:29.939935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:29.948275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:29.948275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:29.948275 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] PATH_INFO: `/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8/users/7804958fdf9641418c661b8165af0b95/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:29.957586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaa5a9c985f46ddae01e9e844d2c5c8, user_id=7804958fdf9641418c661b8165af0b95, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:29.960267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:30.014368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:30.019031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1254/2517] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:29 2022] PUT /identity/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8/users/7804958fdf9641418c661b8165af0b95/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:30.022946 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:30.032980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1f0b-7467-42db-a4e0-a66c3bfbc82c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:30.088232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:30.088839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:30.089119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:30.089392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:30.090022 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:30.091618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e142bd14-6928-4ad2-8a00-68779005c19a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:30.101809 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1264/2518] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:30.105996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:30.116211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ce800-2b73-49f6-8ada-bf9c3855d6f2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:30.121968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:30.122690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:30.122955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:30.123227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] PATH_INFO: `/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8/users/7804958fdf9641418c661b8165af0b95/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:30.125303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=faaa5a9c985f46ddae01e9e844d2c5c8, user_id=7804958fdf9641418c661b8165af0b95, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:30.128098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:30.140846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1255/2519] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:30 2022] PUT /identity/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8/users/7804958fdf9641418c661b8165af0b95/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:30.150932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:30.151221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:30.151499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:30.179190 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] MFA Rules not processed for user `7804958fdf9641418c661b8165af0b95`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:30.181096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:30.257472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1265/2520] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:30.268634 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:30.270416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:30.327430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345256-f8de-4690-9e30-04a2ef5c0dca admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:30.331052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:30.331713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:30.332025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:30.332299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:30.341699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:30.343225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:30.353047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1256/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:30.469129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:30.479604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f65958-e5a2-4a91-b02f-4f5ca636b385 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:30.483335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:30.483970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:30.484254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:30.484528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:30.505042 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:30.543019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:30.544481 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c492128-794f-4213-bdeb-1137f3840f24 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:30.553283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1266/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:34.044629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:34.091262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e94f9-bee3-40e7-912a-32723e2a629a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:34.091797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e94f9-bee3-40e7-912a-32723e2a629a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:34.091797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e94f9-bee3-40e7-912a-32723e2a629a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:34.113507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bd6e94f9-bee3-40e7-912a-32723e2a629a None None] MFA Rules not processed for user `4608fa0bbc114c0bb0ea3e6240faaed7`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:34.113507 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bd6e94f9-bee3-40e7-912a-32723e2a629a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:34.115831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc1066-50ba-4ad5-ba75-a5a1b0a3d2cf service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:34.121475 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:34.122109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:34.122413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:34.122687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] PATH_INFO: `/v3/users/f87a1c5294984b06bf35bf3742b50008` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:34.123803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f87a1c5294984b06bf35bf3742b50008)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:34.125781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:34.168505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1267/2523] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:34.325372 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f87a1c5294984b06bf35bf3742b50008'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:34.396172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f87a1c5294984b06bf35bf3742b50008'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:34.406535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f87a1c5294984b06bf35bf3742b50008'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:34.406535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f87a1c5294984b06bf35bf3742b50008'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:34.406535 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f87a1c5294984b06bf35bf3742b50008'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:34.424278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1257/2524] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:34 2022] DELETE /identity/v3/users/f87a1c5294984b06bf35bf3742b50008 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:34.428687 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:34.428973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:34.429274 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:34.449056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:34.450252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:34.528664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1268/2525] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:34.535422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:34.537581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:34.554796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:34.603497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b51a91-a2ce-4af4-b8c0-abbbd6264b87 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:34.607721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:34.608446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:34.608732 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:34.609010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:34.618374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:34.620458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bfd09-e220-4550-a6e1-64aebb2aa05b service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:34.630066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1258/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:34.663316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:34.664876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:34.677220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26818db2-32de-4ab8-8686-21d313f42f41 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:34.682535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:34.686099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:34.686099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:34.686099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] PATH_INFO: `/v3/users/8b1eebf8a4b44305a7a81f31f365fdfc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:34.686099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b1eebf8a4b44305a7a81f31f365fdfc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:34.686984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:34.914440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b1eebf8a4b44305a7a81f31f365fdfc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.008136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b1eebf8a4b44305a7a81f31f365fdfc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.012041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b1eebf8a4b44305a7a81f31f365fdfc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.012041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b1eebf8a4b44305a7a81f31f365fdfc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.017557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b1eebf8a4b44305a7a81f31f365fdfc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.019050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:35.039974 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1269/2527] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:34 2022] DELETE /identity/v3/users/8b1eebf8a4b44305a7a81f31f365fdfc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:35.044916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:35.046234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:35.046234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:35.064425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:35.065777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:35.073537 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:35.075237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:35.150771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1259/2528] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:35.161187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:35.162939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:35.176959 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c412-d1b5-45fb-923f-9abc3cafdf2a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:35.184375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:35.185018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:35.185296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:35.185570 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] PATH_INFO: `/v3/projects/421da927e80d446e8e4e86a14e02a13d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:35.186710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=421da927e80d446e8e4e86a14e02a13d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:35.188739 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:35.229396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404143bd-9b04-4378-86fe-361590c29dbc None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:35.233109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:35.233709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:35.233991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:35.234266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:35.244132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:35.245564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:35.256394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1260/2529] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:35.332106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421da927e80d446e8e4e86a14e02a13d', 'request_id': 'req-441222a2-0a65-4272-ae30-202c08ddde3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.340557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421da927e80d446e8e4e86a14e02a13d', 'request_id': 'req-441222a2-0a65-4272-ae30-202c08ddde3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.436982 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421da927e80d446e8e4e86a14e02a13d', 'request_id': 'req-441222a2-0a65-4272-ae30-202c08ddde3b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.452382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] The token cache is being invalidate because project 421da927e80d446e8e4e86a14e02a13d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:35.452676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.453462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.455377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1270/2530] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:35 2022] DELETE /identity/v3/projects/421da927e80d446e8e4e86a14e02a13d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:35.463579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:35.472664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab4b157-69b4-4db1-bf11-cbc845e063a5 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:35.561583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:35.568891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:35.569555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:35.569842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:35.570675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] PATH_INFO: `/v3/users/f32efa138bcb4bf893f7be0b0f5ab28f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:35.572577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32efa138bcb4bf893f7be0b0f5ab28f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:35.574588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:35.707108 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:35.708710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:35.730410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441222a2-0a65-4272-ae30-202c08ddde3b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:35.744731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:35.745573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:35.746191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:35.746540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] PATH_INFO: `/v3/projects/94d1eadaf33d4f598382c270a52b6665` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:35.748083 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d1eadaf33d4f598382c270a52b6665)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:35.751113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:35.756326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32efa138bcb4bf893f7be0b0f5ab28f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.887567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32efa138bcb4bf893f7be0b0f5ab28f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.888233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32efa138bcb4bf893f7be0b0f5ab28f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.888852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32efa138bcb4bf893f7be0b0f5ab28f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.896554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32efa138bcb4bf893f7be0b0f5ab28f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.914387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1261/2531] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:35 2022] DELETE /identity/v3/users/f32efa138bcb4bf893f7be0b0f5ab28f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:35.930002 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d1eadaf33d4f598382c270a52b6665', 'request_id': 'req-68e2b212-9b36-47d1-bb52-1376135b35e0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:35.937165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d1eadaf33d4f598382c270a52b6665', 'request_id': 'req-68e2b212-9b36-47d1-bb52-1376135b35e0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.013443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d1eadaf33d4f598382c270a52b6665', 'request_id': 'req-68e2b212-9b36-47d1-bb52-1376135b35e0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.014980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:36.026992 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] The token cache is being invalidate because project 94d1eadaf33d4f598382c270a52b6665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:36.027366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.028063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.029638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1271/2532] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:35 2022] DELETE /identity/v3/projects/94d1eadaf33d4f598382c270a52b6665 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:36.033698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.035183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:36.102205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8eef29-a84d-496c-944d-3b65dc154daf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.162836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:36.163479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.163761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.164078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] PATH_INFO: `/v3/users/a55b259b8eea4a82b99d4c4a97efa6d9` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.165488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55b259b8eea4a82b99d4c4a97efa6d9)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:36.167170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:36.190926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:36.426539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.428187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:36.433897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55b259b8eea4a82b99d4c4a97efa6d9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.441923 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b212-9b36-47d1-bb52-1376135b35e0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.446607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:36.447847 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.448130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.448403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] PATH_INFO: `/v3/projects/443a3ee6d5f248f1afcbac30403fbb53` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.449538 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443a3ee6d5f248f1afcbac30403fbb53)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:36.451459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:36.487543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55b259b8eea4a82b99d4c4a97efa6d9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.488512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55b259b8eea4a82b99d4c4a97efa6d9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.489175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55b259b8eea4a82b99d4c4a97efa6d9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.498371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fd5970ef-d34c-42ef-9bf1-c84c32f9c596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55b259b8eea4a82b99d4c4a97efa6d9'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.516006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1262/2533] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:36 2022] DELETE /identity/v3/users/a55b259b8eea4a82b99d4c4a97efa6d9 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:36.545119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443a3ee6d5f248f1afcbac30403fbb53', 'request_id': 'req-db6fdde2-7585-4ef2-b862-3a005a131865'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.551831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443a3ee6d5f248f1afcbac30403fbb53', 'request_id': 'req-db6fdde2-7585-4ef2-b862-3a005a131865'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.607055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443a3ee6d5f248f1afcbac30403fbb53', 'request_id': 'req-db6fdde2-7585-4ef2-b862-3a005a131865'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.619439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] The token cache is being invalidate because project 443a3ee6d5f248f1afcbac30403fbb53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:36.619729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.620400 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-db6fdde2-7585-4ef2-b862-3a005a131865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:36.621895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1272/2534] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:36 2022] DELETE /identity/v3/projects/443a3ee6d5f248f1afcbac30403fbb53 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:36.626961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.632069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.632069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.646899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:36.648139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:36.707892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1263/2535] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:36.716500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872297b1-22a6-4329-946f-698d19e90462 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.717011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872297b1-22a6-4329-946f-698d19e90462 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.717341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872297b1-22a6-4329-946f-698d19e90462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.738886 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-872297b1-22a6-4329-946f-698d19e90462 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:36.740148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-872297b1-22a6-4329-946f-698d19e90462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:36.749389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1273/2536] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:36.757987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.768341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a7e85-6d4b-474b-a761-3eb51ff9fecd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.773431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:36.774265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.775306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.775715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.776472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:36.776845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:36.778650 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:36.790854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1264/2537] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:06:36.795470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872297b1-22a6-4329-946f-698d19e90462 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.805536 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872297b1-22a6-4329-946f-698d19e90462 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.812278 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:36.812904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.813184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.813457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.814094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:36.816062 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:36.898666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1274/2538] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:36 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:36.902543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.904445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:36.906430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:36.911210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062fc59-e5a3-4c7b-80db-e85ec1ccd1af admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.991817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e2989-b1f1-41a7-8db0-a5e177352bd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:36.997247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:36.997885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:36.998164 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:36.998436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] PATH_INFO: `/v3/projects/1762f1ff88464dd387a8e2eac08ae301` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:36.999633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1762f1ff88464dd387a8e2eac08ae301)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.001653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.005009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.005636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.005925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.006204 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.006839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.008875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.124110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1265/2539] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:36 2022] POST /identity/v3/users => generated 287 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:37.128375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:37.140730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79345407-d8c9-401f-8b04-b0d07efd22cf admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:37.150068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.150068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.150068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.150068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.150592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.151855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.161542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1762f1ff88464dd387a8e2eac08ae301', 'request_id': 'req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.167218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1266/2540] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:37.168482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:37.175419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:37.178901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9a5b6-5b89-4816-b373-6baf00078eb6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:37.180095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1762f1ff88464dd387a8e2eac08ae301', 'request_id': 'req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.183303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:37.241994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1762f1ff88464dd387a8e2eac08ae301', 'request_id': 'req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.247069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.256311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.256311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.256311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.256311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.256311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.264472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1267/2541] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:37.264661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] The token cache is being invalidate because project 1762f1ff88464dd387a8e2eac08ae301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:37.264661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.265331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.265570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:37.267284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:37.267972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1275/2542] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:36 2022] DELETE /identity/v3/projects/1762f1ff88464dd387a8e2eac08ae301 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:37.271592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:37.275225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:37.280645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a66a49-a7a5-4b47-a1f9-9ba9edf1f2dc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:37.285392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.286133 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.286515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.286863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] PATH_INFO: `/v3/projects/ab3f086c059941d8b1056fd1c65b4e7f/users/8b05ce4e3307482a825f9999801a0869/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.293943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1da512-3856-4e8f-8d4e-83dcd49dd2c0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:37.301731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.308107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.308235 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f086c059941d8b1056fd1c65b4e7f, user_id=8b05ce4e3307482a825f9999801a0869, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.308354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.308354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] PATH_INFO: `/v3/users/7804958fdf9641418c661b8165af0b95` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.308541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362962db-e5cb-49d6-9ca4-e1c9018fcfd1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.308640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7804958fdf9641418c661b8165af0b95)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.309171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.419386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1268/2543] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:37 2022] PUT /identity/v3/projects/ab3f086c059941d8b1056fd1c65b4e7f/users/8b05ce4e3307482a825f9999801a0869/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:37.424338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.424687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.424967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.445727 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:37.447733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:37.510625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1269/2544] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:37.526462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:37.527833 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:37.544065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7804958fdf9641418c661b8165af0b95'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.589782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a49ed-1ab1-4a62-b4fe-e752c1d973dd None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:37.593640 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:37.594526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:37.594805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:37.595081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:37.601492 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7804958fdf9641418c661b8165af0b95'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.602123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7804958fdf9641418c661b8165af0b95'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.602725 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7804958fdf9641418c661b8165af0b95'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.605545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:37.607090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:37.611045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-b302c595-ce68-4966-8033-0f21d3423bb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7804958fdf9641418c661b8165af0b95'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:37.617815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1270/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:37.633853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1276/2546] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:37 2022] DELETE /identity/v3/users/7804958fdf9641418c661b8165af0b95 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:38.578589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:38.591644 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21db2f0-fdfc-45c4-89bc-8d70659a3519 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:38.618881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:38.673513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:38.674752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:38.675141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:38.675505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] PATH_INFO: `/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:38.677243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faaa5a9c985f46ddae01e9e844d2c5c8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:38.679962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:38.784105 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faaa5a9c985f46ddae01e9e844d2c5c8', 'request_id': 'req-07757e8e-28ff-410e-b181-073e27ed9722'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:38.876154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faaa5a9c985f46ddae01e9e844d2c5c8', 'request_id': 'req-07757e8e-28ff-410e-b181-073e27ed9722'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:38.885403 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faaa5a9c985f46ddae01e9e844d2c5c8', 'request_id': 'req-07757e8e-28ff-410e-b181-073e27ed9722'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:38.902752 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] The token cache is being invalidate because project faaa5a9c985f46ddae01e9e844d2c5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:38.903326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:38.904244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-07757e8e-28ff-410e-b181-073e27ed9722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:38.906059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1271/2547] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:38 2022] DELETE /identity/v3/projects/faaa5a9c985f46ddae01e9e844d2c5c8 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:38.912811 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:38.913241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:38.913433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:38.949465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:38.951018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:39.025988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1277/2548] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:39.034205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.034498 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.034770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.064387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:39.066893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:39.084306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1272/2549] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:39.088864 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.098672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb82c89c-e606-484e-97fe-33fcb4ec4565 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.106133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.106754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.107031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.107303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.107990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:39.108293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.109964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2040b-7a14-4912-b374-70a07ad08450 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.128188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1278/2550] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:39.129315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.162871 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c21297-fc4b-43df-8443-a3949710e648 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.176040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.176679 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.176953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.177920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.178059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.181012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.298896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.299248 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.299447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.317624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1273/2551] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:39.323200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.369918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] MFA Rules not processed for user `8b05ce4e3307482a825f9999801a0869`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:39.371699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:39.420155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:39.431322 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f80bbb-31fd-4581-a186-f858c48f98e2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.436688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.437308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.437588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.437911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.439267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.448962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.496954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1279/2552] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:39.501139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.502853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:39.518593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7850a0-ba7d-4cde-b2c8-73e411c3caaa None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.522860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.523683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.523841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.524143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.530187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.530187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.563571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1274/2553] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:39.567645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.580553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a2801-cc91-4a4c-a82f-f4c929397ae6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.586603 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.588748 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.593804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.593804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.593804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.593804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.604336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1275/2554] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:39.608264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.613685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:39.619842 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4d192-fea3-47a8-99ae-8939ef2d3260 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.623815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1280/2555] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:39.626966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.628064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.628702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.629157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.629432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.630136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.631707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.644296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1276/2556] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:39.654109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.664470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02dd0fb-0d19-4e09-bbb9-9722a7daf9d8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.696034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce2d6a-b423-4933-b11c-f4402f2e9d80 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.702204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.702856 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.703133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.703406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.706717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.706717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.765021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.767553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.767553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.767553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] PATH_INFO: `/v3/projects/14b7d2174d544dada823cf2271ae8747/users/43e502dd75944febadd641980f7c50dd/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.786175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14b7d2174d544dada823cf2271ae8747, user_id=43e502dd75944febadd641980f7c50dd, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.789508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bbba4-72e6-4843-a738-919d64bd0d31 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.820685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1281/2557] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:39.825119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.836486 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04c1d1-9144-4cea-98e7-e6324e6cce29 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.842198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.844359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.844359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.844359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.844359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.845617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:39.856035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1282/2558] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:39.860297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:39.877155 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa46eb-ba3d-4739-85e8-6e9f5af8d1b2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:39.877337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1277/2559] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:39 2022] PUT /identity/v3/projects/14b7d2174d544dada823cf2271ae8747/users/43e502dd75944febadd641980f7c50dd/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:39.885286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.885575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.885849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.916659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] MFA Rules not processed for user `43e502dd75944febadd641980f7c50dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:39.917881 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:39.952058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:39.953428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:39.954129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:39.954610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] PATH_INFO: `/v3/projects/c87a0a5516504a27b3cad44777baad05/users/938a4de259ea47c0afafae50d6ef6caf/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:39.987518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87a0a5516504a27b3cad44777baad05, user_id=938a4de259ea47c0afafae50d6ef6caf, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:39.990683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.007689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1278/2560] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:40.021798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.024126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:40.051337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1283/2561] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:39 2022] PUT /identity/v3/projects/c87a0a5516504a27b3cad44777baad05/users/938a4de259ea47c0afafae50d6ef6caf/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:40.069878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.099574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d944dbe-fd29-4fb8-9561-e20c89b82886 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.160036 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968003d0-5312-4efa-8337-1d62842e119d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.166313 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.167167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.167608 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.168059 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.168273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.168682 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.169099 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.169425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.169638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.171383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.184239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1284/2562] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:40.188217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.196871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:40.209347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70eee1-dc55-4cf9-8197-003bd33baa52 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.217699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.218875 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.219353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.219848 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] PATH_INFO: `/v3/projects/c87a0a5516504a27b3cad44777baad05/users/938a4de259ea47c0afafae50d6ef6caf/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.222672 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87a0a5516504a27b3cad44777baad05, user_id=938a4de259ea47c0afafae50d6ef6caf, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.226174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.238203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:40.242898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1285/2563] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:40 2022] PUT /identity/v3/projects/c87a0a5516504a27b3cad44777baad05/users/938a4de259ea47c0afafae50d6ef6caf/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:40.250688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.252488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.264591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1279/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:40.287657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.353967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe424b-2d3d-4915-aed4-021c6f6a400c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.358841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.359565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.359846 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.360245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] PATH_INFO: `/v3/users/43e502dd75944febadd641980f7c50dd` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.361411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e502dd75944febadd641980f7c50dd)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.363337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.394383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.398288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:40.483646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437f21e-4e12-4d84-bd36-cad4f389ea56 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.568023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.568993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.569651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.569651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.573607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:40.583111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e502dd75944febadd641980f7c50dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:40.591166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.592543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd4e3c-c624-4cdf-8dd2-0625e0076a3f service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.604593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1280/2565] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:40.693085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e502dd75944febadd641980f7c50dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:40.694132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e502dd75944febadd641980f7c50dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:40.694834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e502dd75944febadd641980f7c50dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:40.703783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e502dd75944febadd641980f7c50dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:40.724424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1286/2566] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:40 2022] DELETE /identity/v3/users/43e502dd75944febadd641980f7c50dd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:40.729188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.729479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.730754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.750757 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:40.752039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:40.817409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1281/2567] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:40.837696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:40.839370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:40.851525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:40.947493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84aebd-0eb9-44a2-a0df-5e130737d8db admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:40.954032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:40.955296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:40.955597 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:40.955854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:40.967737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:40.969462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0baeb-e97d-43c0-b50a-1ac3d14ba9eb service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:40.979950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1287/2568] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:41.196205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:41.534863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:41.536367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.549765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729f182-ce62-4bac-b951-5210c03d5dcb None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:41.554502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:41.555165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.557086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.557621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] PATH_INFO: `/v3/projects/14b7d2174d544dada823cf2271ae8747` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.559006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14b7d2174d544dada823cf2271ae8747)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:41.561071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:41.682880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14b7d2174d544dada823cf2271ae8747', 'request_id': 'req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:41.701183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24dde2-4f64-4d04-ae66-4a7d30fa5a54 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.701470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24dde2-4f64-4d04-ae66-4a7d30fa5a54 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.701771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24dde2-4f64-4d04-ae66-4a7d30fa5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.731229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0b24dde2-4f64-4d04-ae66-4a7d30fa5a54 None None] MFA Rules not processed for user `938a4de259ea47c0afafae50d6ef6caf`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:41.732662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0b24dde2-4f64-4d04-ae66-4a7d30fa5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.767314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14b7d2174d544dada823cf2271ae8747', 'request_id': 'req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:41.774223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14b7d2174d544dada823cf2271ae8747', 'request_id': 'req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:41.787211 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] The token cache is being invalidate because project 14b7d2174d544dada823cf2271ae8747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:41.787500 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:41.788378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-bf5b7e19-b317-409b-ae4a-f9e51f5b2a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:41.789892 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1282/2569] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:41 2022] DELETE /identity/v3/projects/14b7d2174d544dada823cf2271ae8747 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:41.803451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5681-bc66-4b79-a054-499c4f40d1be None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.803730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5681-bc66-4b79-a054-499c4f40d1be None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.804266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf5681-bc66-4b79-a054-499c4f40d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.807688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1288/2570] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:41.818332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.818709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.823204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.837907 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ecbf5681-bc66-4b79-a054-499c4f40d1be None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:41.839126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ecbf5681-bc66-4b79-a054-499c4f40d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.840046 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] MFA Rules not processed for user `8b05ce4e3307482a825f9999801a0869`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:41.842319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.905868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1289/2571] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:41.913734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1283/2572] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:41.920325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:41.922451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.922821 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.923202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.923963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.945482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:41.947597 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:41.956982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1284/2573] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:41.961043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:41.972136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d115-9c3c-4d69-bbce-416caf95b2a2 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:41.978295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:41.979697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:41.979834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:41.980135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:41.981064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:41.981064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:41.982723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:41.997680 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1285/2574] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:42.001883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.013471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:42.018310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:42.020028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166bf0cf-0933-4352-b783-54c65b99608e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.020212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44cf65-a8d8-476e-ac53-7e346010c696 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.025327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.026043 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.026483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.026770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.027266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.027536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.028318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.028728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.029076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.029934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.031365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:42.045530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.048299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.063289 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1290/2575] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:42.125000 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1286/2576] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:42 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:42.128797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.139588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb427-a0b8-41d6-8f2c-5a0193b43314 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.200291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.200914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.201197 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.201473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.202125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.204151 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.279612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1291/2577] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:42 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:42.281067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.292103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a9ffa-9114-4254-9625-f01a66fa0255 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.296815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.297433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.297734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.298008 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.301455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.301455 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.315236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1287/2578] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:42.316743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.327435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3367b3-036d-446b-9ae9-0010b6bf1b99 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.332268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.332895 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.333239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.333520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.334203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.335826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36be061-b034-4d94-940a-990ca6d50d82 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.351721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1292/2579] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:42.353850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.364708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def7ae-3074-44a1-abba-21f64a1d0562 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.369695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.370526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.370809 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.371080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] PATH_INFO: `/v3/projects/fb5fa3c8424a45338ea0ed0c553b83f9/users/549405f0b7c04ea48de40491a1df07e2/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.387089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb5fa3c8424a45338ea0ed0c553b83f9, user_id=549405f0b7c04ea48de40491a1df07e2, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.389799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.442441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1288/2580] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:42 2022] PUT /identity/v3/projects/fb5fa3c8424a45338ea0ed0c553b83f9/users/549405f0b7c04ea48de40491a1df07e2/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:42.454623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.454917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.455195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.492241 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] MFA Rules not processed for user `549405f0b7c04ea48de40491a1df07e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:42.493749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:42.562948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1293/2581] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:42.575113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:42.576867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:42.634006 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531ba82-7a73-4bac-993b-e2dd7a93c4b9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:42.638367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:42.639118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:42.639464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:42.639811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:42.664468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:42.666528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:42.676011 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1289/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:43.999697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:44.000878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:44.045551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:44.062807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc3a9cb-f4a8-4c31-87b6-d3e380e0c7ab None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:44.066943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:44.067555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:44.067835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:44.068135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:44.069859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:44.133303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:44.134867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10df492-484c-4919-8e7d-2bf55c0ce7cd service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:44.145319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1294/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:46.893290 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:46.902978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73582e5b-91b4-4807-b991-14c201f6354f service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:46.910161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:46.910866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:46.911212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:46.911572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] PATH_INFO: `/v3/users/549405f0b7c04ea48de40491a1df07e2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:46.912948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549405f0b7c04ea48de40491a1df07e2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:46.914870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:47.115042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549405f0b7c04ea48de40491a1df07e2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:47.192255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549405f0b7c04ea48de40491a1df07e2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:47.193591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549405f0b7c04ea48de40491a1df07e2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:47.194482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549405f0b7c04ea48de40491a1df07e2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:47.213415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549405f0b7c04ea48de40491a1df07e2'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:47.240700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1290/2584] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:46 2022] DELETE /identity/v3/users/549405f0b7c04ea48de40491a1df07e2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:47.241557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:47.247136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:47.247136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:47.263408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:47.265092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:47.339011 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1295/2585] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:47.357239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:47.357239 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:47.424698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:47.484261 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5ed14-e6c1-4192-9f60-ffe55322da35 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:47.489859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:47.490583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:47.490968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:47.491299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:47.502234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:47.503947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8990f-b7fd-466a-8f8d-0c1cb9460924 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:47.519964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1291/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:48.074088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.075479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:48.092551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017653c9-c401-48ee-b0aa-7705fc9118ad None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.098325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.099088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.099482 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.099869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] PATH_INFO: `/v3/projects/fb5fa3c8424a45338ea0ed0c553b83f9` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.101512 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb5fa3c8424a45338ea0ed0c553b83f9)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.103667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.297832 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb5fa3c8424a45338ea0ed0c553b83f9', 'request_id': 'req-5bc25dbc-56c0-46ff-8733-e753ba3752b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:48.306358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb5fa3c8424a45338ea0ed0c553b83f9', 'request_id': 'req-5bc25dbc-56c0-46ff-8733-e753ba3752b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:48.385584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb5fa3c8424a45338ea0ed0c553b83f9', 'request_id': 'req-5bc25dbc-56c0-46ff-8733-e753ba3752b5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:48.398171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] The token cache is being invalidate because project fb5fa3c8424a45338ea0ed0c553b83f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:48.398468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:48.399147 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5bc25dbc-56c0-46ff-8733-e753ba3752b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:48.401220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1296/2587] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:48 2022] DELETE /identity/v3/projects/fb5fa3c8424a45338ea0ed0c553b83f9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:48.406813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.408296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.408913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.430253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:48.432042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:48.502991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1292/2588] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:48.511447 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.511736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.512240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.534580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:48.536146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:48.545404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1297/2589] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:48.549131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.560085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cff174-7a45-4212-9a0a-d00ea84b3c68 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.565516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.566422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.566778 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.567266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.568533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:48.568934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.570542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.585286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1293/2590] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:06:48.593645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.596518 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:48.602003 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10963f-c406-4a7d-b85c-97d40debc795 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.607524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.608247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.608887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.609236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.609950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.612174 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.710496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1298/2591] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:48 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:48.711816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.722761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28e4a-82bf-496c-a369-97afe3da9cfb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.781330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.781944 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.782220 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.782489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.783395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.787702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.842957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.846035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:48.858918 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e601ee-abea-4809-b97f-8728b4829e03 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.864159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.864815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.865657 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.865941 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] PATH_INFO: `/v3/users/47aa5cf320134658b77c2fc5e4debcde` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.867153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47aa5cf320134658b77c2fc5e4debcde)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.870722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.879183 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1294/2592] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:48 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:48.884854 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.898418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9962b-5642-4b85-9652-d149e98eb9c2 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.904168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.904787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.909572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.909572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.909572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.909572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.918741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1295/2593] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:48.923436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.933768 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095422cf-8d9e-41a2-b5a2-c6184e18f7b4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.939955 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.940561 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.941397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.941397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.942145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.943954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:48.956014 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1296/2594] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:48.960301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:48.972956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec523e-ee42-4710-a83b-f5b169c6c1e8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:48.978284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:48.979103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:48.979385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:48.979659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] PATH_INFO: `/v3/projects/3ac0fa0abe10418f98b0b0e36a49aee4/users/e28f3b1c6a28431eb2316735fb6e0e99/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:48.996087 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac0fa0abe10418f98b0b0e36a49aee4, user_id=e28f3b1c6a28431eb2316735fb6e0e99, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:48.998882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a491f8-5cdf-436d-b762-0aed98c6efc0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.001411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:49.099636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1297/2595] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:48 2022] PUT /identity/v3/projects/3ac0fa0abe10418f98b0b0e36a49aee4/users/e28f3b1c6a28431eb2316735fb6e0e99/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:49.107703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47aa5cf320134658b77c2fc5e4debcde'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.110021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.110304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.110573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.138271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] MFA Rules not processed for user `e28f3b1c6a28431eb2316735fb6e0e99`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:49.139543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:49.207831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1298/2596] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:49.212575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.219766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47aa5cf320134658b77c2fc5e4debcde'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.220495 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47aa5cf320134658b77c2fc5e4debcde'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.221422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47aa5cf320134658b77c2fc5e4debcde'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.231547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47aa5cf320134658b77c2fc5e4debcde'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.258530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1299/2597] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:48 2022] DELETE /identity/v3/users/47aa5cf320134658b77c2fc5e4debcde => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:49.285425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f3502-5f3b-4607-b0ab-f63677f0a55e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.353687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.354305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.354589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.355015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.355659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.357702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.467091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1299/2598] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:49 2022] POST /identity/v3/projects => generated 379 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:49.471107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.473670 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:49.487472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cb237-c84e-450d-bb49-1ad8ccbd5c69 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.544113 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.544743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.545012 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.545288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.545973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.547882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.609451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.611141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:49.626019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c979d60-0a30-4af2-b0eb-37f9bbde550b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.630759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.631387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.631695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.632078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] PATH_INFO: `/v3/projects/b8dde4afd11f4a8387f7391e3b0b8b95` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.633217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8dde4afd11f4a8387f7391e3b0b8b95)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.636228 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.666021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1300/2599] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:49 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:49.670057 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.679873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ef5ce-aad2-42ff-9eee-8451eec09990 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.685076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.685656 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.686129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.686245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.686807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.688427 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.698587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1301/2600] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:49.702405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.711717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5384e2-256b-4432-a5bc-eeedd45c7c80 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.716302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.716890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.717168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.717439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.718041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.719571 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.730230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1302/2601] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:49.734079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:49.744658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bd9fb-2c6d-44cb-ac94-322ccc226a52 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:49.753381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:49.754128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.754417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.754714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] PATH_INFO: `/v3/projects/a58a913f6e9b435b972abc37403e9e65/users/de5ffcd1eaa74b33b8098d1f856960c4/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.771345 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a58a913f6e9b435b972abc37403e9e65, user_id=de5ffcd1eaa74b33b8098d1f856960c4, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:49.774154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b11ce4-fa60-4d03-82a6-38b7d3fbfe36 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:49.777168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:49.787430 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dde4afd11f4a8387f7391e3b0b8b95', 'request_id': 'req-1c13bb27-21bf-429b-b768-8f2cc885ffa4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.874040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dde4afd11f4a8387f7391e3b0b8b95', 'request_id': 'req-1c13bb27-21bf-429b-b768-8f2cc885ffa4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.878938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1303/2602] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:49 2022] PUT /identity/v3/projects/a58a913f6e9b435b972abc37403e9e65/users/de5ffcd1eaa74b33b8098d1f856960c4/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:49.890548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.891224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.891395 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dde4afd11f4a8387f7391e3b0b8b95', 'request_id': 'req-1c13bb27-21bf-429b-b768-8f2cc885ffa4'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.891719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.905128 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] The token cache is being invalidate because project b8dde4afd11f4a8387f7391e3b0b8b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:49.905349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.906138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1c13bb27-21bf-429b-b768-8f2cc885ffa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:49.907951 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1300/2603] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:49 2022] DELETE /identity/v3/projects/b8dde4afd11f4a8387f7391e3b0b8b95 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:49.912707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531a432-bafe-48c0-beb4-d00a27ff8f17 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:49.917923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531a432-bafe-48c0-beb4-d00a27ff8f17 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:49.917923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531a432-bafe-48c0-beb4-d00a27ff8f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:49.924800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] MFA Rules not processed for user `de5ffcd1eaa74b33b8098d1f856960c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:49.926219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:49.933705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-b531a432-bafe-48c0-beb4-d00a27ff8f17 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:49.934995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b531a432-bafe-48c0-beb4-d00a27ff8f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.009767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1304/2604] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:50.011156 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1301/2605] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:50.014671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.016071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.020240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.022676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.022676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.031871 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7ab0a-3676-4415-be0c-5ab39a43c65d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.036625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.037303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.037653 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.038030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.038773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.042070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.045309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:50.046780 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.055370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1302/2606] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:50.059309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.071648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe39e43-bacf-422d-bbec-e430bcba6a82 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.078997 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.079674 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.080100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.080443 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.081167 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:50.081553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.083894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.096713 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:50.099414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1303/2607] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:06:50.104444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.114351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6895b61-6da1-4e36-b28f-09cfd1c6436b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.119259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.119904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.120353 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.120676 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.121307 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.123894 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.129928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1305/2608] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:50.134070 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.202765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020abb0c-9661-41ad-8584-3debd645b1ee admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.207701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.208360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.208689 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.209106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.209872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.211786 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.243019 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1304/2609] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:50.247282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.312015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481afdbe-40af-4933-ba93-cccabb0e6aca admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.316958 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.317564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.317852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.318127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.318755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.320855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.340699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1306/2610] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:06:50.345102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.366418 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a749ce-cadc-40a0-a3aa-dfc59410cca7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.371618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.380244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.380244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.380244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.380244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.380244 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.387086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1307/2611] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:50.391324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.402084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5b0c4-6e42-41b0-8e97-8b4e1b043bb1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.407141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.407842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.408157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.408438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] PATH_INFO: `/v3/projects/49e1d392e611449fbfb56565660ac85c/users/4dbb9b71c3b14f70a3972e2afe61714e/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.424089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1d392e611449fbfb56565660ac85c, user_id=4dbb9b71c3b14f70a3972e2afe61714e, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.426723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.442013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1305/2612] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:50.446124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.457023 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd6a73-4b24-43b8-8bc7-18e1c51f7661 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.463836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.464521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.464815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.465060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.465702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.467296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.478293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1306/2613] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:50.482190 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.492877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab35544-d2e2-4aa9-ace8-6ac9ee160094 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.499792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1308/2614] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:50 2022] PUT /identity/v3/projects/49e1d392e611449fbfb56565660ac85c/users/4dbb9b71c3b14f70a3972e2afe61714e/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:50.504722 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.556786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.557392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.557671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.557949 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.558589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.560185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.569170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5020cf7-4802-4480-aba7-c21a5d95b068 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.569875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1307/2615] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:50.574927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.576551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.577163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.577441 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.577710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.578380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.579985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.584401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2ace4-ab60-4d8e-8656-4721f5b57f16 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.589877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.590459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1309/2616] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:50.592526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.592869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.593149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] PATH_INFO: `/v3/projects/9c1e67ad1b9a439d9cbc7127c18293d5/users/8bcec1e008cf4a318e424c0732095862/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.594558 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.604651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038fbf9-4528-41eb-9944-4b08dd4b01ca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.608614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e67ad1b9a439d9cbc7127c18293d5, user_id=8bcec1e008cf4a318e424c0732095862, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.610748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.611244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fbf3e-ac30-4412-8c7e-215eb9f9d703 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.611392 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.611671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.611968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] PATH_INFO: `/v3/projects/49e1d392e611449fbfb56565660ac85c/users/4dbb9b71c3b14f70a3972e2afe61714e/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.615388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e1d392e611449fbfb56565660ac85c, user_id=4dbb9b71c3b14f70a3972e2afe61714e, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.618068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cd96c-43ca-467a-a699-1dc601d49f85 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.628229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1310/2617] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:50 2022] PUT /identity/v3/projects/49e1d392e611449fbfb56565660ac85c/users/4dbb9b71c3b14f70a3972e2afe61714e/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:50.638338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.638625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.638901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.664492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1308/2618] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:50 2022] PUT /identity/v3/projects/9c1e67ad1b9a439d9cbc7127c18293d5/users/8bcec1e008cf4a318e424c0732095862/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:06:50.667601 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] MFA Rules not processed for user `4dbb9b71c3b14f70a3972e2afe61714e`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:50.668879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.670549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:50.675637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.675857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.676276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.703618 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] MFA Rules not processed for user `8bcec1e008cf4a318e424c0732095862`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:50.704866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.717365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:50.742359 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1311/2619] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:50.753997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.755561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.769079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1309/2620] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:06:50.780247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:50.781612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.814403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9979-c64e-4f72-a864-bf6e1c271905 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.818142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.818754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.819035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.819305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.821118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:50.854385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01701cd6-edc0-44b3-8ca8-a0dcc67bb65d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:50.860704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:50.861486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:50.861761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:50.862025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:50.869947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.871569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.880804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1310/2621] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:50.884268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:50.885714 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:50.892474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:50.897347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1312/2622] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:50.939017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:53.072152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:53.082160 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa50c3-7912-4faf-a3a1-17c19da9a2f3 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:53.086208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:53.086960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:53.087311 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:53.087585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:53.144279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:53.145816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d025d59-8183-410f-a945-7ab2580d70d9 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:53.154845 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1311/2623] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:54.514802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:54.525047 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42873132-4a26-4df7-b9fe-bbc22dc38e91 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:54.528454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:54.529068 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:54.529346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:54.529618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:54.542208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:54.543758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:54.557121 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1313/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:56.860827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:56.861306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:56.861411 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:56.882308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:56.883538 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:56.939657 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1312/2625] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:56.964283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:56.965741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:57.036960 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8235665-dbcc-43a2-8d42-19a92a7d4660 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:57.042119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:57.042741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:57.046448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:57.046448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:57.051840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:57.053471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27adf1-1462-4138-87a6-790c89690882 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:57.061663 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1314/2626] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:06:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:06:57.346552 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:57.433604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e8c8c-245d-4632-89c9-5e89d839e014 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:57.440293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:57.440954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:57.441241 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:57.441512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] PATH_INFO: `/v3/users/8bcec1e008cf4a318e424c0732095862` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:57.442925 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bcec1e008cf4a318e424c0732095862)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:57.445010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:57.452244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:57.649975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bcec1e008cf4a318e424c0732095862'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:57.750607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bcec1e008cf4a318e424c0732095862'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:57.751588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bcec1e008cf4a318e424c0732095862'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:57.752466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bcec1e008cf4a318e424c0732095862'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:57.771728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bcec1e008cf4a318e424c0732095862'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:57.801827 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1313/2627] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:57 2022] DELETE /identity/v3/users/8bcec1e008cf4a318e424c0732095862 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:57.805821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:57.806542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:57.807049 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:57.843414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:57.843414 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:57.920613 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1315/2628] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:57.931624 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:57.933719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:58.030911 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1659bb9-92f1-43f6-970e-5456110f253c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:58.031512 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:58.032457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:58.032989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:58.033531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:58.062865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:58.065009 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172d472-9f75-41ad-843e-b0f4435bb5cd service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:58.078106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1314/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:06:58.508624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:58.511752 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:58.551587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3fe3-ca22-44a9-84bf-13f7563c9a56 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:58.572053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:58.573338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:58.573965 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:58.574626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] PATH_INFO: `/v3/projects/9c1e67ad1b9a439d9cbc7127c18293d5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:58.579116 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e67ad1b9a439d9cbc7127c18293d5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:58.582555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:58.735301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e67ad1b9a439d9cbc7127c18293d5', 'request_id': 'req-550aaef8-18a7-4da1-ac77-d3647089a473'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:58.738372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:58.743949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e67ad1b9a439d9cbc7127c18293d5', 'request_id': 'req-550aaef8-18a7-4da1-ac77-d3647089a473'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:58.837736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e67ad1b9a439d9cbc7127c18293d5', 'request_id': 'req-550aaef8-18a7-4da1-ac77-d3647089a473'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:58.854404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] The token cache is being invalidate because project 9c1e67ad1b9a439d9cbc7127c18293d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:06:58.854703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:58.855348 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-550aaef8-18a7-4da1-ac77-d3647089a473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:58.856866 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1316/2630] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:06:58 2022] DELETE /identity/v3/projects/9c1e67ad1b9a439d9cbc7127c18293d5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:58.862382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:58.862862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:58.863192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:58.887601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:58.888965 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:58.971976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1315/2631] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:58.981360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:58.985185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:58.985185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.008539 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:59.008995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.020635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1317/2632] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:59.026081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.037062 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea2ff7-e0e4-4397-835e-16c86ab276f1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.042848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.043569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.043777 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.044088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.044675 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:06:59.045022 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.047080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.071468 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1316/2633] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:06:59.073159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.091489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f0057-0d03-4707-91f5-8792c1fa31b6 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.097363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.098187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.098531 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.098975 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.099623 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.102365 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.213204 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1318/2634] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:06:59 2022] POST /identity/v3/projects => generated 403 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:59.216937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.217494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.219082 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.229469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f209d87e-4e09-43ec-be97-80c44b44295f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.245331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:59.309919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.310698 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.311092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.311448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.312257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.314574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.315429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe91e7-9dfe-4c5b-ab39-60bd41cf12cd admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.321156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.322879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.323160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.323431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.325232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.402225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.417994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.421614 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1317/2635] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:06:59 2022] POST /identity/v3/users => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:06:59.423070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.445087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1319/2636] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:06:59.454454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62228f4d-a941-4839-8bf2-f198d1728218 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.477013 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.478433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.478891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.479343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.480769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.483005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.504589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.505825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1318/2637] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:06:59.508585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.514025 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.524683 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3926-f3d3-4452-8adc-6da8661ba69b service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.531808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.532855 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.533232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.533658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.534419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.535507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53ac48-216d-4060-a1db-6877168dee12 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.536840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.542138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.542982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.543437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.543771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] PATH_INFO: `/v3/users/e28f3b1c6a28431eb2316735fb6e0e99` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.545054 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28f3b1c6a28431eb2316735fb6e0e99)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.546979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.557138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1320/2638] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:06:59.558561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.574736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b67db-1277-48c5-8406-1499fe712345 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.581842 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:06:59.582755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.583032 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.583309 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] PATH_INFO: `/v3/projects/7524a235499742c3bd653a9fae2656e6/users/c0b9406f039a40f58f81f67d621b277d/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.605627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7524a235499742c3bd653a9fae2656e6, user_id=c0b9406f039a40f58f81f67d621b277d, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:06:59.609138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ac490-ff7e-4c93-a0a7-6293dc9067d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:06:59.723841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1321/2639] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:06:59 2022] PUT /identity/v3/projects/7524a235499742c3bd653a9fae2656e6/users/c0b9406f039a40f58f81f67d621b277d/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:59.729987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.731010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.731626 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.755592 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:59.757223 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.786125 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:06:59.799879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28f3b1c6a28431eb2316735fb6e0e99'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:59.842007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1322/2640] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:06:59.855354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:06:59.861077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:06:59.887684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28f3b1c6a28431eb2316735fb6e0e99'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:59.888976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28f3b1c6a28431eb2316735fb6e0e99'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:59.890832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28f3b1c6a28431eb2316735fb6e0e99'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:59.908606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-fe90384e-98f8-4575-a268-24559f9e9bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28f3b1c6a28431eb2316735fb6e0e99'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:06:59.932785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1319/2641] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:06:59 2022] DELETE /identity/v3/users/e28f3b1c6a28431eb2316735fb6e0e99 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:06:59.937717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:06:59.938061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:06:59.938514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:06:59.955408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2af7f7-e325-4512-a2b6-8695bc3c9b10 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:06:59.962555 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:06:59.963886 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:00.027967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:00.028736 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:00.029087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:00.029429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:00.034493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:00.061786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1320/2642] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:00.069834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:00.073888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:00.091100 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482348a-ae9f-4ef6-af73-948cf4fbac4e None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:00.095874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:00.097585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:00.097932 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:00.098254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:00.108534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:00.112454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:00.113900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:00.126316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1321/2643] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:07:00.132256 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:00.136096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:00.147777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1323/2644] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:00.776314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:00.777811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:00.809159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55fe65-c8f5-4274-b36c-4a8ecffd06ae service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:00.817456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:00.818325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:00.818979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:00.819431 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] PATH_INFO: `/v3/projects/3ac0fa0abe10418f98b0b0e36a49aee4` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:00.821359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac0fa0abe10418f98b0b0e36a49aee4)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:00.824032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:00.968875 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac0fa0abe10418f98b0b0e36a49aee4', 'request_id': 'req-eb7f6136-7491-48e9-8106-63a050af0561'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.036289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac0fa0abe10418f98b0b0e36a49aee4', 'request_id': 'req-eb7f6136-7491-48e9-8106-63a050af0561'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.044082 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac0fa0abe10418f98b0b0e36a49aee4', 'request_id': 'req-eb7f6136-7491-48e9-8106-63a050af0561'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.061940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] The token cache is being invalidate because project 3ac0fa0abe10418f98b0b0e36a49aee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:01.064394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.064394 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-eb7f6136-7491-48e9-8106-63a050af0561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.068201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1322/2645] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:00 2022] DELETE /identity/v3/projects/3ac0fa0abe10418f98b0b0e36a49aee4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:01.069451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:01.084928 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4264ab-62e7-4f5b-960b-4f6e2fce7d0c service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:01.145751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:01.182058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:01.183039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:01.183403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:01.187775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] PATH_INFO: `/v3/users/de5ffcd1eaa74b33b8098d1f856960c4` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:01.187775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5ffcd1eaa74b33b8098d1f856960c4)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:01.188335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:01.390532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5ffcd1eaa74b33b8098d1f856960c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.453030 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5ffcd1eaa74b33b8098d1f856960c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.453705 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5ffcd1eaa74b33b8098d1f856960c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.454456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5ffcd1eaa74b33b8098d1f856960c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.472572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5ffcd1eaa74b33b8098d1f856960c4'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:01.507989 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1324/2646] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:01 2022] DELETE /identity/v3/users/de5ffcd1eaa74b33b8098d1f856960c4 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:02.037559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.038200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.038417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.085112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] MFA Rules not processed for user `c0b9406f039a40f58f81f67d621b277d`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:02.087706 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:02.163448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.166467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:02.192649 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1323/2647] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:02.199772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.200882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:02.280688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d2dc0-a7bd-41bc-946c-2e775f305d22 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.291388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.291589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619c2ab-2164-4b88-91bd-0eb81c7c8d5d None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.292576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.293109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.293578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] PATH_INFO: `/v3/projects/a58a913f6e9b435b972abc37403e9e65` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.295064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a58a913f6e9b435b972abc37403e9e65)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.297339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.298639 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.299414 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.299857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.300264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.301139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.304968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.322306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:02.412565 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1324/2648] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:02 2022] POST /identity/v3/projects => generated 405 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:02.416244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.466134 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a58a913f6e9b435b972abc37403e9e65', 'request_id': 'req-16b5120c-79ce-40f3-ab10-08d7c278576d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.471183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:02.474472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a58a913f6e9b435b972abc37403e9e65', 'request_id': 'req-16b5120c-79ce-40f3-ab10-08d7c278576d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.498869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533921c3-f0d4-4384-9d88-73b6b0a7bec1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.544389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a58a913f6e9b435b972abc37403e9e65', 'request_id': 'req-16b5120c-79ce-40f3-ab10-08d7c278576d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.562091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] The token cache is being invalidate because project a58a913f6e9b435b972abc37403e9e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:02.562422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.563682 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.564972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1325/2649] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:02 2022] DELETE /identity/v3/projects/a58a913f6e9b435b972abc37403e9e65 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:02.569962 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.572789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:02.588434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.589072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.589492 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.590067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.590469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.592497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.655648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5120c-79ce-40f3-ab10-08d7c278576d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.659540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1325/2650] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:02 2022] POST /identity/v3/users => generated 309 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:02.665879 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.666517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.666619 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:02.666698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.666698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.667044 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] PATH_INFO: `/v3/users/4dbb9b71c3b14f70a3972e2afe61714e` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.669058 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbb9b71c3b14f70a3972e2afe61714e)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.670978 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.689163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51148a-5b20-47c9-9ab5-563178677cda admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.695095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.695779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.696994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.697277 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.699480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.704704 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.721436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1326/2651] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:02.723168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.737376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d81b9b-b2f5-4c06-a9cd-90d43e821617 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:02.743147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:02.744076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:02.744305 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:02.744580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] PATH_INFO: `/v3/projects/246455b0dc6046a28a0f81e383d7bc0e/users/091067d2331e4b24a45f0321d0c7b36c/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:02.769377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246455b0dc6046a28a0f81e383d7bc0e, user_id=091067d2331e4b24a45f0321d0c7b36c, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:02.772135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:02.870645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbb9b71c3b14f70a3972e2afe61714e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:02.898888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1327/2652] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:02 2022] PUT /identity/v3/projects/246455b0dc6046a28a0f81e383d7bc0e/users/091067d2331e4b24a45f0321d0c7b36c/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:02.901786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:02.986251 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:02.998033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66f748-c468-4868-8ea1-6d62068e7eb4 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:03.007308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:03.007308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:03.007308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:03.007308 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:03.008061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:03.010408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:03.021939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1328/2653] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:03.025025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbb9b71c3b14f70a3972e2afe61714e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:03.025967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbb9b71c3b14f70a3972e2afe61714e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:03.026834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbb9b71c3b14f70a3972e2afe61714e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:03.026971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:03.029848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:03.042474 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbb9b71c3b14f70a3972e2afe61714e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:03.050688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cb63d-726c-4c79-92f8-fe83c7202dda admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:03.062398 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:03.064284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:03.065342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:03.067144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] PATH_INFO: `/v3/projects/246455b0dc6046a28a0f81e383d7bc0e/users/091067d2331e4b24a45f0321d0c7b36c/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:03.070377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=246455b0dc6046a28a0f81e383d7bc0e, user_id=091067d2331e4b24a45f0321d0c7b36c, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:03.074687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233b7356-13e1-4a0c-b0b8-c3cb5d9428a0 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:03.075573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1326/2654] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:02 2022] DELETE /identity/v3/users/4dbb9b71c3b14f70a3972e2afe61714e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:03.108325 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1329/2655] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:03 2022] PUT /identity/v3/projects/246455b0dc6046a28a0f81e383d7bc0e/users/091067d2331e4b24a45f0321d0c7b36c/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:03.721883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:03.723958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:03.936818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c457a-f655-43e4-a387-0a20a6f540e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:03.936818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:03.956922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:03.957624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:03.957905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:03.958177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] PATH_INFO: `/v3/projects/49e1d392e611449fbfb56565660ac85c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:03.959334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e1d392e611449fbfb56565660ac85c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:03.961368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:04.244458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e1d392e611449fbfb56565660ac85c', 'request_id': 'req-00bd04e3-575a-437a-bcd6-c0aed335efae'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:04.250968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e1d392e611449fbfb56565660ac85c', 'request_id': 'req-00bd04e3-575a-437a-bcd6-c0aed335efae'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:04.345344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e1d392e611449fbfb56565660ac85c', 'request_id': 'req-00bd04e3-575a-437a-bcd6-c0aed335efae'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:04.363878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] The token cache is being invalidate because project 49e1d392e611449fbfb56565660ac85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:04.364201 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:04.364867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-00bd04e3-575a-437a-bcd6-c0aed335efae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:04.367081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1327/2656] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:03 2022] DELETE /identity/v3/projects/49e1d392e611449fbfb56565660ac85c => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:04.373503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:04.374003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:04.374148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:04.407912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:04.409295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:04.510404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1330/2657] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:04.518271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:04.518834 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:04.519043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:04.546854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:04.549775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:04.562159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1328/2658] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:04.569051 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:04.579733 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8bc95-6f6f-4d46-a88d-375d280bdd1c None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:04.589924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:04.591207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:04.591707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:04.592230 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:04.593834 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:04.594621 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:04.597086 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:04.625844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1331/2659] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:04.627264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:04.638227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9468e3-924a-46ae-a8c0-0efd98061c2d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:04.646191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:04.646953 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:04.647356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:04.647701 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:04.648625 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:04.651043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:04.760168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1329/2660] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:04 2022] POST /identity/v3/projects => generated 389 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:04.765354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:04.782203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7693182-8394-431e-82d5-c5e6d3835f56 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:04.869792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:04.870428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:04.870642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:04.870914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:04.871548 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:04.873523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:04.989320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1332/2661] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:04 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:04.990916 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:05.005435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93ec0-2d5e-4fbf-9178-592db0cc1063 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:05.014636 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:05.015337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.015621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.015896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.016581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:05.018228 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:05.035233 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:05.036330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1330/2662] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:05.046659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88929424-1090-4911-afaf-accb16e00193 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:05.056509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:05.056509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.056509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.056509 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.057224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:05.059803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3abb1-ea05-4abd-9d3f-904fadad553a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:05.079697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:05.080798 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1333/2663] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:05.112677 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08ea84-3367-46f5-b0e9-96699d70f4d0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:05.119508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:05.120435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.120933 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.121712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] PATH_INFO: `/v3/projects/e560e9302f184b7f80ef2165c2414d66/users/fc8ba694c1c44400a0062a7c6a92b6d8/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.175050 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e560e9302f184b7f80ef2165c2414d66, user_id=fc8ba694c1c44400a0062a7c6a92b6d8, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:05.181947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0829c87-a9f9-43f0-91e0-c9735c34ee68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:05.201138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.201671 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.202306 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.257941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] MFA Rules not processed for user `091067d2331e4b24a45f0321d0c7b36c`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:05.259376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:05.300889 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1331/2664] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:05 2022] PUT /identity/v3/projects/e560e9302f184b7f80ef2165c2414d66/users/fc8ba694c1c44400a0062a7c6a92b6d8/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:05.302225 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:05.385183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.385578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.385964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.415688 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1334/2665] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:05.425792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] MFA Rules not processed for user `fc8ba694c1c44400a0062a7c6a92b6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:05.425792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:05.450748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:05.499985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1332/2666] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:05.512002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:05.513581 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:05.588071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015b788-fe04-46cc-a527-303bd8478f2a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:05.648967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:05.650081 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:05.650367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:05.650642 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:05.660295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:05.665909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:05.673629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1335/2667] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:05 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:06.942129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:06.943838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:07.041887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa0e7a-a52e-4df7-a6c9-60f8b811d535 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:07.049138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:07.050188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:07.050667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:07.051158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] PATH_INFO: `/v3/users/c0b9406f039a40f58f81f67d621b277d` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:07.053338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b9406f039a40f58f81f67d621b277d)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:07.055416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:07.337530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b9406f039a40f58f81f67d621b277d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:07.441817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b9406f039a40f58f81f67d621b277d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:07.442438 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b9406f039a40f58f81f67d621b277d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:07.443043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b9406f039a40f58f81f67d621b277d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:07.453885 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b9406f039a40f58f81f67d621b277d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:07.508156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1333/2668] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:06 2022] DELETE /identity/v3/users/c0b9406f039a40f58f81f67d621b277d => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:07.900765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:07.918268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91186cc3-6649-41ca-a271-6f16551243a1 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:07.994390 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:07.995295 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:07.995599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:07.995987 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] PATH_INFO: `/v3/projects/7524a235499742c3bd653a9fae2656e6` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:07.997137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7524a235499742c3bd653a9fae2656e6)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:07.999032 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:08.128562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:08.155263 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7524a235499742c3bd653a9fae2656e6', 'request_id': 'req-0edfe085-8c37-43e2-8015-95dfe2c8dec6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.231813 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7524a235499742c3bd653a9fae2656e6', 'request_id': 'req-0edfe085-8c37-43e2-8015-95dfe2c8dec6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.251116 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7524a235499742c3bd653a9fae2656e6', 'request_id': 'req-0edfe085-8c37-43e2-8015-95dfe2c8dec6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.269923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] The token cache is being invalidate because project 7524a235499742c3bd653a9fae2656e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:08.270330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.271206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.273381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1336/2669] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:07 2022] DELETE /identity/v3/projects/7524a235499742c3bd653a9fae2656e6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:08.277996 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:08.282422 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:08.304416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b6273-7a91-4748-958c-44e052fb0e1a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:08.355937 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:08.374426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:08.375255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:08.375617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:08.376024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] PATH_INFO: `/v3/users/091067d2331e4b24a45f0321d0c7b36c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:08.377551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091067d2331e4b24a45f0321d0c7b36c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:08.379693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:08.584268 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091067d2331e4b24a45f0321d0c7b36c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.699051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091067d2331e4b24a45f0321d0c7b36c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.699717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091067d2331e4b24a45f0321d0c7b36c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.700401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091067d2331e4b24a45f0321d0c7b36c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.714162 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-9b0912aa-2e59-4df3-a70f-257998197a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091067d2331e4b24a45f0321d0c7b36c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:08.741146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1334/2670] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:08 2022] DELETE /identity/v3/users/091067d2331e4b24a45f0321d0c7b36c => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:09.044396 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:09.048392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:09.072393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfe085-8c37-43e2-8015-95dfe2c8dec6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:09.162717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:09.163843 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:09.164164 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:09.164449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] PATH_INFO: `/v3/projects/246455b0dc6046a28a0f81e383d7bc0e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:09.166541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=246455b0dc6046a28a0f81e383d7bc0e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:09.170774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:09.302060 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246455b0dc6046a28a0f81e383d7bc0e', 'request_id': 'req-5b90f230-3803-451a-9d3f-36371efae7dd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:09.396026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246455b0dc6046a28a0f81e383d7bc0e', 'request_id': 'req-5b90f230-3803-451a-9d3f-36371efae7dd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:09.404123 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246455b0dc6046a28a0f81e383d7bc0e', 'request_id': 'req-5b90f230-3803-451a-9d3f-36371efae7dd'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:09.417130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] The token cache is being invalidate because project 246455b0dc6046a28a0f81e383d7bc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:09.417691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:09.421074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-5b90f230-3803-451a-9d3f-36371efae7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:09.424052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1337/2671] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:09 2022] DELETE /identity/v3/projects/246455b0dc6046a28a0f81e383d7bc0e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:09.431862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:09.431862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:09.431862 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:09.595587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:09.596857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:09.665357 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1335/2672] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:09.674444 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:09.674814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:09.675163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:09.701695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:09.702933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:09.712781 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1338/2673] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:09.717156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:09.728434 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de17e9-e8d0-4993-a2ff-2cf6a4e90a51 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:09.736293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:09.737059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:09.737431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:09.737795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:09.745079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:09.745079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:09.745079 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:09.772095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1336/2674] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:09.772824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:09.783330 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121d2a8-6b2e-4dbb-afde-3ec430c0b35b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:09.797326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:09.797956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:09.798232 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:09.798514 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:09.799298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:09.801607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:09.894457 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1339/2675] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:09 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:09.898917 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:09.912272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a79dc-74b6-40fb-82d5-d4bc675b34d5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.007803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:10.018913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.019622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.019929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.020253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.020924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.022883 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.113911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1337/2676] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:09 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:10.119138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.130135 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1b671-678d-46b1-bfd1-1c705b172662 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.135482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.136393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.136893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.137179 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.138917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.142467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.159005 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1340/2677] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:10.165008 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.179678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e21556-ada1-4850-a119-116cf8b8c85c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.186884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.187738 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.188056 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.188332 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.189059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.192007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740724-fbf8-4e0b-bf60-34bf30b62420 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.203208 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1338/2678] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:10.207908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.226260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea51065-2202-4e6b-a03b-65eba49956ea admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.233593 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.234728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.235172 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.235655 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] PATH_INFO: `/v3/projects/3f8e390d7e8640949a1a0de52e9bd20a/users/f9c4842b886d4eceb77da3d3a36e5a7f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.239320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:10.260281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8e390d7e8640949a1a0de52e9bd20a, user_id=f9c4842b886d4eceb77da3d3a36e5a7f, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.264508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.374973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1341/2679] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:10 2022] PUT /identity/v3/projects/3f8e390d7e8640949a1a0de52e9bd20a/users/f9c4842b886d4eceb77da3d3a36e5a7f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:10.386381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.386530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.386817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.448754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] MFA Rules not processed for user `f9c4842b886d4eceb77da3d3a36e5a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:10.452425 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:10.570966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1339/2680] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:10.575855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.652420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94309c-e53e-4edb-b63c-d6a03ddcb28c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.658113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.659124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.659605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.659883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.661071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.664678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.735370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1342/2681] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:10 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:10.740167 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.754014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87e138-531f-459c-9ad0-0b42ffe356f9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.821584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.822247 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.822827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.827821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.827821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.827821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.890776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1340/2682] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:10 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:10.892124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.909615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193c099-036e-4d58-a3ea-05338e459e86 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.917563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.918504 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.919121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.919521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.920508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.922432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:10.940527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1343/2683] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:10.945009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:10.956935 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40fced-88be-4f6f-b693-7b2027cb8338 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:10.961879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:10.965957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:10.965957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:10.965957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] PATH_INFO: `/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee/users/5773a496ae8d4d70b50b39d19713bedf/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:10.983969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0534b6bb864812b2c7ec2a72e51fee, user_id=5773a496ae8d4d70b50b39d19713bedf, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:10.987028 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:11.304913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1341/2684] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:10 2022] PUT /identity/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee/users/5773a496ae8d4d70b50b39d19713bedf/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:11.309532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:11.320380 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce4c44-9e44-4b00-bb37-4638d31fd06f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:11.407158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:11.408273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:11.408273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:11.408608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:11.409281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:11.411383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8196cc-e690-463e-8a01-6cab606b2f1b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:11.423078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1344/2685] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:11.427221 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:11.449909 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd56d-bea5-42ef-b8b7-21b10ca140ca admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:11.456171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:11.456898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:11.457187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:11.457461 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] PATH_INFO: `/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee/users/5773a496ae8d4d70b50b39d19713bedf/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:11.459994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a0534b6bb864812b2c7ec2a72e51fee, user_id=5773a496ae8d4d70b50b39d19713bedf, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:11.462159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:11.476189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1342/2686] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:11 2022] PUT /identity/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee/users/5773a496ae8d4d70b50b39d19713bedf/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:11.486767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:11.491586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:11.491586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:11.534564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] MFA Rules not processed for user `5773a496ae8d4d70b50b39d19713bedf`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:11.534564 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:11.600284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:11.643171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1345/2687] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:11.658267 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:11.660573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:11.677177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:11.737394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7ec09-c566-46bd-be40-847d2d80b397 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:11.742233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:11.742998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:11.743179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:11.743456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:11.755998 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:11.758106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f6d57-5f41-463c-965b-185a50881517 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:11.778932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1343/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:12.965269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:13.064004 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07de5b-d8ac-4e5f-b9ef-55f8c5bc2cb7 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:13.069141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:13.069685 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:13.070010 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:13.070237 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] PATH_INFO: `/v3/users/f9c4842b886d4eceb77da3d3a36e5a7f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:13.071489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c4842b886d4eceb77da3d3a36e5a7f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:13.073728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:13.285198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c4842b886d4eceb77da3d3a36e5a7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:13.387461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c4842b886d4eceb77da3d3a36e5a7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:13.389499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c4842b886d4eceb77da3d3a36e5a7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:13.396165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c4842b886d4eceb77da3d3a36e5a7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:13.401103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c4842b886d4eceb77da3d3a36e5a7f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:13.427338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1346/2689] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:12 2022] DELETE /identity/v3/users/f9c4842b886d4eceb77da3d3a36e5a7f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:13.436910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:13.437322 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:13.437465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:13.489698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:13.491390 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:13.576272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1344/2690] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:13.584267 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:13.585794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:13.688358 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27353eb8-c29d-4ccc-9b90-7c3d5c4062b6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:13.693711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:13.694815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:13.695298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:13.695746 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:13.708653 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:13.710302 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:13.716719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:13.722867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1347/2691] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:14.209096 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:14.210704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:14.239508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079642b-6435-4b5f-9748-08df82d80470 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:14.253226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:14.253963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:14.254304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:14.254596 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] PATH_INFO: `/v3/projects/3f8e390d7e8640949a1a0de52e9bd20a` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:14.255840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8e390d7e8640949a1a0de52e9bd20a)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:14.257954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:14.402237 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8e390d7e8640949a1a0de52e9bd20a', 'request_id': 'req-78eacaa7-0a90-4d37-92a2-2abf09deaea5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.408771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8e390d7e8640949a1a0de52e9bd20a', 'request_id': 'req-78eacaa7-0a90-4d37-92a2-2abf09deaea5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.543973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8e390d7e8640949a1a0de52e9bd20a', 'request_id': 'req-78eacaa7-0a90-4d37-92a2-2abf09deaea5'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.556255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] The token cache is being invalidate because project 3f8e390d7e8640949a1a0de52e9bd20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:14.556543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.557202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.558690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1345/2692] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:14 2022] DELETE /identity/v3/projects/3f8e390d7e8640949a1a0de52e9bd20a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:14.562600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:14.573030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf8074-42ad-4a76-ab9f-2bc62c61f629 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:14.627313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:14.627961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:14.628243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:14.628580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] PATH_INFO: `/v3/users/5773a496ae8d4d70b50b39d19713bedf` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:14.629710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5773a496ae8d4d70b50b39d19713bedf)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:14.631697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:14.899803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5773a496ae8d4d70b50b39d19713bedf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.968299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5773a496ae8d4d70b50b39d19713bedf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.970542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5773a496ae8d4d70b50b39d19713bedf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.970542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5773a496ae8d4d70b50b39d19713bedf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:14.985016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-64fff464-a860-4104-8293-78006e37b23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5773a496ae8d4d70b50b39d19713bedf'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.010931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1348/2693] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:14 2022] DELETE /identity/v3/users/5773a496ae8d4d70b50b39d19713bedf => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:15.557189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:15.560041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:15.583419 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eacaa7-0a90-4d37-92a2-2abf09deaea5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:15.618850 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:15.647654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:15.648346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:15.648649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:15.648921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] PATH_INFO: `/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:15.650660 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a0534b6bb864812b2c7ec2a72e51fee)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:15.656451 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:15.790285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a0534b6bb864812b2c7ec2a72e51fee', 'request_id': 'req-f6cccafa-5be5-4db8-b349-9f2be00daa2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.795938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a0534b6bb864812b2c7ec2a72e51fee', 'request_id': 'req-f6cccafa-5be5-4db8-b349-9f2be00daa2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.875610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a0534b6bb864812b2c7ec2a72e51fee', 'request_id': 'req-f6cccafa-5be5-4db8-b349-9f2be00daa2e'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.888159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] The token cache is being invalidate because project 7a0534b6bb864812b2c7ec2a72e51fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:15.888446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.889077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-f6cccafa-5be5-4db8-b349-9f2be00daa2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:15.890552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1346/2694] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:15 2022] DELETE /identity/v3/projects/7a0534b6bb864812b2c7ec2a72e51fee => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:15.895450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:15.895940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:15.896035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:15.918153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:15.919453 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:15.984428 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1349/2695] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:15.993364 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:15.993649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:15.993927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.013775 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:16.015768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:16.022767 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1347/2696] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:16.027719 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.038575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dc3f3-27f9-4287-a69a-24de2d9efb43 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.043800 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.044450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.044775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.045113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.045862 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:16.046490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.048146 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.060586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1350/2697] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:16.065176 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.075261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06604bc-84df-46d0-b303-44e11da4a511 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.080085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.080690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.080966 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.081236 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.081873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.083750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.203326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1348/2698] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:16.207678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.217434 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348478a2-609a-43a7-8d1d-0a62224a8c14 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.220971 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:16.274589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.275201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.275483 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.275758 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.276419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.278368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.373898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1351/2699] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:16.378119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.389214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e8a21-2372-4bcb-b28a-0c2524038cd0 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.393927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.395432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.395432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.395432 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.395911 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.397496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.407972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1349/2700] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:16.411868 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.422516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256024c0-9e02-4a17-8eac-82a888c8994e admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.427340 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.427994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.428281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.428556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.429193 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.431466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68649a0-d415-482f-9d92-e9e0b1f9053a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.442038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1352/2701] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:16.446184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.456366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e9407-3b44-4e29-b522-d3fb3123ab6c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.461406 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.462065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.462347 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.462671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] PATH_INFO: `/v3/projects/796c611a6e7148e3a83568f8ad954c30/users/6ab11fbbd1b44c659aca728439475f85/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.478562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=796c611a6e7148e3a83568f8ad954c30, user_id=6ab11fbbd1b44c659aca728439475f85, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.481308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee0676-fff9-4fc3-b44d-d8e14f90c51f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.563764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1350/2702] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:16 2022] PUT /identity/v3/projects/796c611a6e7148e3a83568f8ad954c30/users/6ab11fbbd1b44c659aca728439475f85/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:16.576761 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.577048 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.577324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.613494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] MFA Rules not processed for user `6ab11fbbd1b44c659aca728439475f85`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:16.614448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:16.658120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.658411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.658690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.677940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:16.679148 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:16.691502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1353/2703] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:16.695826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.735580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1351/2704] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:16.749251 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.751098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:16.762661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:16.764420 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2639a0f-67bb-4cce-b19f-7bc030061080 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.769149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.769759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.770209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.770318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.770938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.772885 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.821168 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826936f2-4bf8-4e4f-a438-03c58b037466 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.826532 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.827165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.827448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.827719 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.835610 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.837751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:16.845721 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1352/2705] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:07:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 23 14:07:16.901313 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:16.908779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1354/2706] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:16.911873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:16.923969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf11aa-f5e8-4466-b814-5a2c251dac13 service swift] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:16.983195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:16.983971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:16.984337 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:16.984729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:16.985366 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:16.987362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.125870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1353/2707] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:16 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:17.128391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:17.138790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d1e05-d61c-4e51-9560-104a5df59514 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:17.143600 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:17.144257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.144541 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.144817 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.145490 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:17.147184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.158224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1355/2708] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:17.162693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:17.173816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a89af-aeee-4c92-949a-ad114331d5d6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:17.179468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:17.180243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.180523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.180820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] PATH_INFO: `/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e/users/7c2038d79673421a8500beabde106ed0/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.195399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0cbfdfeedf4f78bad8f92a3ec6cc0e, user_id=7c2038d79673421a8500beabde106ed0, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:17.198829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.277004 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1354/2709] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:17 2022] PUT /identity/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e/users/7c2038d79673421a8500beabde106ed0/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:17.281039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:17.302364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad1d19-ad98-4e6c-96fb-c15dcd193cd9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:17.365301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:17.365982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.366259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.373571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.373571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:17.373571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a9fe8-aa50-417a-89dd-d8d2726ea435 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.379891 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1356/2710] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:17.385214 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:17.407018 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc55bb-37f9-4342-83f8-b59c5c3bb88e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:17.412380 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:17.419912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.419912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.419912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] PATH_INFO: `/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e/users/7c2038d79673421a8500beabde106ed0/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.419912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0cbfdfeedf4f78bad8f92a3ec6cc0e, user_id=7c2038d79673421a8500beabde106ed0, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:17.419912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.430253 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1355/2711] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:17 2022] PUT /identity/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e/users/7c2038d79673421a8500beabde106ed0/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:17.441168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.441485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.441765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.475473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] MFA Rules not processed for user `7c2038d79673421a8500beabde106ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:17.476739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:17.549801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1357/2712] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:17.562128 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:17.564007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:17.624849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed52536e-5d2e-4824-88f6-f8176bdaeed8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:17.628678 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:17.629296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:17.629578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:17.629852 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:17.634898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:17.690218 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:17.691648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba10d0b-e9f5-46c3-b277-20ab1bc0d2ce service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:17.701529 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1356/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:18.430435 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:18.430923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:18.498409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a312620-e30b-4079-aba3-c7685eb8981b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:18.503257 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:18.503938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:18.504219 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:18.504520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] PATH_INFO: `/v3/users/fc8ba694c1c44400a0062a7c6a92b6d8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:18.505670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc8ba694c1c44400a0062a7c6a92b6d8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:18.507691 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:18.520637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:18.786877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc8ba694c1c44400a0062a7c6a92b6d8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:18.876409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc8ba694c1c44400a0062a7c6a92b6d8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:18.877109 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc8ba694c1c44400a0062a7c6a92b6d8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:18.877898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc8ba694c1c44400a0062a7c6a92b6d8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:18.885975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc8ba694c1c44400a0062a7c6a92b6d8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:18.904370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1358/2714] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:18 2022] DELETE /identity/v3/users/fc8ba694c1c44400a0062a7c6a92b6d8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:18.908820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:18.909312 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:18.909408 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:18.927785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:18.928999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:18.988485 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1357/2715] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:18.998497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:18.999906 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.057458 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69498715-566a-4ff9-8d1b-ce2db3459eeb admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:19.061057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:19.061660 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.061938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.062208 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.071042 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:19.073446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:19.082745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1359/2716] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:19.420026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:19.421500 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.482054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def737f3-b7bf-4550-b71c-251bff4a851f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:19.485665 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:19.486301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.486582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.486853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.488588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.551180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:19.554260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:19.555868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2fe4-2a0b-4ef0-8a2a-b423aa6cd8a4 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:19.558178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:19.560145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.568401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1358/2717] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:19.575206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1889e-6554-47d7-9c06-ee93aecb6317 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:19.581807 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:19.582699 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.583151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.583591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] PATH_INFO: `/v3/projects/e560e9302f184b7f80ef2165c2414d66` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.585188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e560e9302f184b7f80ef2165c2414d66)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:19.595876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:19.717941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e560e9302f184b7f80ef2165c2414d66', 'request_id': 'req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:19.789973 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e560e9302f184b7f80ef2165c2414d66', 'request_id': 'req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:19.796788 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e560e9302f184b7f80ef2165c2414d66', 'request_id': 'req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:19.804234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a32f-bf3c-403d-b6ff-743dc30c474a None None] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.804523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a32f-bf3c-403d-b6ff-743dc30c474a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.804819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9a32f-bf3c-403d-b6ff-743dc30c474a None None] PATH_INFO: `/` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.807470 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1359/2718] 10.222.0.48 () {54 vars in 961 bytes} [Fri Sep 23 14:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 23 14:07:19.811393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] The token cache is being invalidate because project e560e9302f184b7f80ef2165c2414d66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:19.811622 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.811904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.812119 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:19.812231 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.812967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:19.814523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1360/2719] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:19 2022] DELETE /identity/v3/projects/e560e9302f184b7f80ef2165c2414d66 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:19.842294 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] MFA Rules not processed for user `4590313e50ef4de6b2d6a54467b13a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:19.843565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.922240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1360/2720] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Sep 23 14:07:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:19.923579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:19.939656 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae0c83-5a74-4224-8fc5-5fb67bd4c8f6 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:19.944532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:19.945236 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:19.945591 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:19.946007 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:19.949192 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:19.970055 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:19.972651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:20.002888 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:20.004863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:20.026928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1361/2721] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:20.079648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffc219-69cd-4a93-96a1-17c5674228e4 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:20.085076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:20.085599 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:20.085878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:20.086152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] PATH_INFO: `/v3/users/4608fa0bbc114c0bb0ea3e6240faaed7` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:20.087299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4608fa0bbc114c0bb0ea3e6240faaed7)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:20.089329 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:20.283404 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4608fa0bbc114c0bb0ea3e6240faaed7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.372951 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4608fa0bbc114c0bb0ea3e6240faaed7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.373621 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4608fa0bbc114c0bb0ea3e6240faaed7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.374295 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4608fa0bbc114c0bb0ea3e6240faaed7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.381833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-da15f554-4c86-4401-99d1-d1d5bf675b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4608fa0bbc114c0bb0ea3e6240faaed7'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.399374 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1361/2722] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:19 2022] DELETE /identity/v3/users/4608fa0bbc114c0bb0ea3e6240faaed7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:20.637064 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:20.642531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:20.648961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331e294-02c7-4a1d-81cc-abe0bb3c25b0 service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:20.707095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:20.707836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:20.708151 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:20.708473 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] PATH_INFO: `/v3/projects/96f94a1b77134e84807df4495272b3ad` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:20.710144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96f94a1b77134e84807df4495272b3ad)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:20.712523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:20.796596 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96f94a1b77134e84807df4495272b3ad', 'request_id': 'req-e4d3545f-4979-4492-bd28-dcf23624b238'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.852771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96f94a1b77134e84807df4495272b3ad', 'request_id': 'req-e4d3545f-4979-4492-bd28-dcf23624b238'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.859661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96f94a1b77134e84807df4495272b3ad', 'request_id': 'req-e4d3545f-4979-4492-bd28-dcf23624b238'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.870998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] The token cache is being invalidate because project 96f94a1b77134e84807df4495272b3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:20.871293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.871989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e4d3545f-4979-4492-bd28-dcf23624b238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:20.873479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1362/2723] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:20 2022] DELETE /identity/v3/projects/96f94a1b77134e84807df4495272b3ad => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:20.878581 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:20.879122 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:20.879534 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:20.904105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:20.904105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:20.907227 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:20.963560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1362/2724] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:20.971993 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:20.972273 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:20.972556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:20.992449 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:20.993678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:21.002354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1363/2725] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:21.006741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.017184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c86b7-a0ed-4953-a2de-c3518e46a663 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.021922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.022528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.022806 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.023075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.023744 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:21.024077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.026282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.037882 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1363/2726] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:07:21.042203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.051522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e42be-6b5c-4f25-93bd-b1ddb8aa1cf9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.056141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.056738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.057018 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.058486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.058486 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.059937 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.151797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1364/2727] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:21 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:21.156101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.165820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354b30e7-1826-4e6b-9cc3-17d58df1cfba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.223968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.224578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.224859 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.225129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.225754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.227641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.310575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1364/2728] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:21 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:21.314824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.325999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b675beb-e311-4e5e-8cf1-51d8768286cc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.330545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.331132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.331423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.331722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.332397 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.334021 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.343815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1365/2729] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:21.352017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.362260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555865e1-a9b3-4517-80cb-a81f8dfd126e admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.366840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.367431 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.367708 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.368120 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.375245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.375245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d940e-8374-43e3-8ec9-399b1ea72ad5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.381153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1365/2730] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:21.385982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.395979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5daf7-21ac-493e-bfc4-57ec2712f27c admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.400513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.401161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.401442 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.401718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] PATH_INFO: `/v3/projects/be22d0b07fe346cebd38321744aa4c53/users/c6d4efa2b8a94f6db54b52b7b7799d56/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.416487 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be22d0b07fe346cebd38321744aa4c53, user_id=c6d4efa2b8a94f6db54b52b7b7799d56, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.419386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.498899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1366/2731] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:21 2022] PUT /identity/v3/projects/be22d0b07fe346cebd38321744aa4c53/users/c6d4efa2b8a94f6db54b52b7b7799d56/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:21.511230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.511515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.511789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.538634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] MFA Rules not processed for user `c6d4efa2b8a94f6db54b52b7b7799d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:21.539835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:21.607368 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1366/2732] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:21.618570 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:21.620969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:21.653523 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:21.679465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01f7bd-0d6b-4e68-ad4d-78a64cdb2a4f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:21.683756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:21.684416 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:21.684697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:21.684970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:21.693392 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:21.694828 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb62054-62cc-4c19-ab97-40116953e2b6 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:21.703816 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1367/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:07:24.068624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:24.070033 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:24.079612 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:24.134731 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc9114-7f62-48c7-a372-671b5c30a093 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:24.140041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:24.140669 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:24.140954 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:24.141226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] PATH_INFO: `/v3/users/6ab11fbbd1b44c659aca728439475f85` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:24.142349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab11fbbd1b44c659aca728439475f85)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:24.144302 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:24.370306 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab11fbbd1b44c659aca728439475f85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:24.464578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab11fbbd1b44c659aca728439475f85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:24.465279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab11fbbd1b44c659aca728439475f85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:24.467555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab11fbbd1b44c659aca728439475f85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:24.475252 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab11fbbd1b44c659aca728439475f85'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:24.493803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1367/2734] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:24 2022] DELETE /identity/v3/users/6ab11fbbd1b44c659aca728439475f85 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:24.498700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:24.499150 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:24.499418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:24.518569 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:24.519819 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:24.579904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1368/2735] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:24.590466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:24.591892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:24.647888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385c1c9-2854-46ea-88c6-4cae55d99152 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:24.652129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:24.652728 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:24.653009 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:24.653281 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:24.662144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:24.663584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:24.673000 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1368/2736] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:25.057838 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:25.059587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:25.075165 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc898a4-0c2d-4761-9a62-6b26c4a448b9 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:25.080918 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:25.081627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:25.081990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:25.082262 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] PATH_INFO: `/v3/projects/796c611a6e7148e3a83568f8ad954c30` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:25.083376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=796c611a6e7148e3a83568f8ad954c30)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:25.094154 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:25.190481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796c611a6e7148e3a83568f8ad954c30', 'request_id': 'req-3b6df174-c4d8-44f1-bf12-7150ee390161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.258296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796c611a6e7148e3a83568f8ad954c30', 'request_id': 'req-3b6df174-c4d8-44f1-bf12-7150ee390161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.265269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796c611a6e7148e3a83568f8ad954c30', 'request_id': 'req-3b6df174-c4d8-44f1-bf12-7150ee390161'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.276604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] The token cache is being invalidate because project 796c611a6e7148e3a83568f8ad954c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:25.277061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.277598 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.279085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1369/2737] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:25 2022] DELETE /identity/v3/projects/796c611a6e7148e3a83568f8ad954c30 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:25.283117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:25.292772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9ca3e-8af1-488b-be62-cc9ab392f034 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:25.318535 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:25.350724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:25.351370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:25.351654 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:25.352019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] PATH_INFO: `/v3/users/7c2038d79673421a8500beabde106ed0` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:25.353149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c2038d79673421a8500beabde106ed0)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:25.355130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:25.507331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c2038d79673421a8500beabde106ed0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.550095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c2038d79673421a8500beabde106ed0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.550929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c2038d79673421a8500beabde106ed0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.551642 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c2038d79673421a8500beabde106ed0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.560591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-1fa84e78-0115-465f-bedb-6ca5ea5d48a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c2038d79673421a8500beabde106ed0'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:25.579776 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1369/2738] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:25 2022] DELETE /identity/v3/users/7c2038d79673421a8500beabde106ed0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:26.146039 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.148450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:26.164497 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6df174-c4d8-44f1-bf12-7150ee390161 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.224226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:26.231052 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.236101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.236101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.236101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] PATH_INFO: `/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.236101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0cbfdfeedf4f78bad8f92a3ec6cc0e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.236101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:26.362212 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0cbfdfeedf4f78bad8f92a3ec6cc0e', 'request_id': 'req-b8271468-2b88-4ef0-a655-f9ecead9a628'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.436121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0cbfdfeedf4f78bad8f92a3ec6cc0e', 'request_id': 'req-b8271468-2b88-4ef0-a655-f9ecead9a628'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.442505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0cbfdfeedf4f78bad8f92a3ec6cc0e', 'request_id': 'req-b8271468-2b88-4ef0-a655-f9ecead9a628'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.456028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] The token cache is being invalidate because project 0a0cbfdfeedf4f78bad8f92a3ec6cc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:26.456352 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.457117 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.458929 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1370/2739] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:26 2022] DELETE /identity/v3/projects/0a0cbfdfeedf4f78bad8f92a3ec6cc0e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:26.464234 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce650ec-7a52-4673-b557-f72d0b8bc591 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.464815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce650ec-7a52-4673-b557-f72d0b8bc591 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.464815 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce650ec-7a52-4673-b557-f72d0b8bc591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.485212 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-bce650ec-7a52-4673-b557-f72d0b8bc591 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:26.487587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-bce650ec-7a52-4673-b557-f72d0b8bc591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:26.544984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.546587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:26.548573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1370/2740] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:26.557868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.558181 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.558465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.562298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8271468-2b88-4ef0-a655-f9ecead9a628 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.567415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.568264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.568607 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.568945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] PATH_INFO: `/v3/users/8b05ce4e3307482a825f9999801a0869` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.570136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b05ce4e3307482a825f9999801a0869)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.572811 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:26.578970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:26.583502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:26.588135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1371/2741] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:26.592276 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.601328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94841f6-8cf7-4ceb-aabd-2981d1035a3a None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.605988 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.606576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.606857 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.607129 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.607774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:26.608106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.613829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:26.621496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1372/2742] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:07:26.625707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.636152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa497d33-f112-49bc-a761-7121ca32ee04 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.641950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.641950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.641950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.641950 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.642462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.644401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:26.751805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1373/2743] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:26 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:26.755938 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.759510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b05ce4e3307482a825f9999801a0869'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.765370 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:26.818104 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba4c8b-622a-4f2d-a385-6367f2bea1d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.823648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.824290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.824572 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.824844 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.825472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.827373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:26.829693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b05ce4e3307482a825f9999801a0869'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.830470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b05ce4e3307482a825f9999801a0869'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.831200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b05ce4e3307482a825f9999801a0869'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.841415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b05ce4e3307482a825f9999801a0869'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:26.859149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1371/2744] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:26 2022] DELETE /identity/v3/users/8b05ce4e3307482a825f9999801a0869 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:26.910820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1374/2745] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:26 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:26.914887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:26.916877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:26.981716 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:26.985601 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405bb7-dacd-4b83-aea1-72c73bd4f119 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:26.990408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:26.991120 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:26.991466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:26.991814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:26.992539 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:26.994806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.004938 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1372/2746] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:27.008860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.019316 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f41487-3ccd-4254-a2f3-29c70c0ff478 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.024785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.025457 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.025740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.026016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.026664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.028351 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.042795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1375/2747] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:27.043883 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.054375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf5f3-429d-4f37-9721-e2f06c198b4f admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.059978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.060692 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.061029 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.061238 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] PATH_INFO: `/v3/projects/029af5aff1664993b868eac1d0244d4b/users/8192cd3d8b214b76a3438e5a3535e269/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.076191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] RBAC: Authorizing `identity:create_grant(project_id=029af5aff1664993b868eac1d0244d4b, user_id=8192cd3d8b214b76a3438e5a3535e269, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.079590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d83a5f-a529-4c4c-b603-3ca394cf655f admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.128977 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.130816 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:27.144735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925bf8e-b4dd-402f-a34e-e5107d50f89a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.149490 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.150158 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.150446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.150724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] PATH_INFO: `/v3/projects/ab3f086c059941d8b1056fd1c65b4e7f` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.151872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3f086c059941d8b1056fd1c65b4e7f)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.153803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.168553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1373/2748] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:27 2022] PUT /identity/v3/projects/029af5aff1664993b868eac1d0244d4b/users/8192cd3d8b214b76a3438e5a3535e269/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:27.179465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.179759 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.180085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.207654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] MFA Rules not processed for user `8192cd3d8b214b76a3438e5a3535e269`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:27.209066 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:27.260843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3f086c059941d8b1056fd1c65b4e7f', 'request_id': 'req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.266459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3f086c059941d8b1056fd1c65b4e7f', 'request_id': 'req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.275785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1374/2749] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:27.280371 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.342864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b0604-d813-470b-b06d-3e0a0d3a3cd1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.343991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3f086c059941d8b1056fd1c65b4e7f', 'request_id': 'req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.357126 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] The token cache is being invalidate because project ab3f086c059941d8b1056fd1c65b4e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:27.357415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.358103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.359956 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1376/2750] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:27 2022] DELETE /identity/v3/projects/ab3f086c059941d8b1056fd1c65b4e7f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:27.363703 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.365135 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:27.403124 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.403744 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.404058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.404334 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.404970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.406995 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.418855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:27.431498 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6a9c6-f5f5-4b4c-bf5e-dc42df49d51d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.436284 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.436915 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.437200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.437476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] PATH_INFO: `/v3/users/938a4de259ea47c0afafae50d6ef6caf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.438671 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=938a4de259ea47c0afafae50d6ef6caf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.440688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.451170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:27.522839 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1375/2751] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:27 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:27.527285 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.528877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:27.589742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d4564-b624-4143-ad01-1662fa903aef admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.594378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.594988 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.595276 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.595550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.596207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.598114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.644319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938a4de259ea47c0afafae50d6ef6caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.705103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938a4de259ea47c0afafae50d6ef6caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.705777 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938a4de259ea47c0afafae50d6ef6caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.706382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938a4de259ea47c0afafae50d6ef6caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.714718 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1376/2752] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:27 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:27.714891 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938a4de259ea47c0afafae50d6ef6caf'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:27.715840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.717531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:27.731368 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e51259-827a-45cc-9247-c3f24942ebce admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.732774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1377/2753] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:27 2022] DELETE /identity/v3/users/938a4de259ea47c0afafae50d6ef6caf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:27.796532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.797184 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.797471 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.797747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.798393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.800103 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.810543 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1377/2754] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:27.814867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.826059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50afee-05f0-4001-a45c-210e97ca6202 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:27.830845 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:27.831505 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:27.831789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:27.832117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] PATH_INFO: `/v3/projects/bcdd554a60d943d1b9a823748a2dc034/users/d68a8359d9ca4610a708f29b7a173afc/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:27.848783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdd554a60d943d1b9a823748a2dc034, user_id=d68a8359d9ca4610a708f29b7a173afc, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:27.851477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:27.961411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1378/2755] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:27 2022] PUT /identity/v3/projects/bcdd554a60d943d1b9a823748a2dc034/users/d68a8359d9ca4610a708f29b7a173afc/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:27.966180 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:27.977270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bbf1c-bd72-41e6-abb0-8761a25519b7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.015734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.017604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.043493 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.044147 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.044506 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.044684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.045348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.046914 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.057508 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1378/2756] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:28.061792 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.072625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a45d9e-850f-4e5a-acd0-55f0ec6fad20 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.077739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.078412 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.078695 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.078968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] PATH_INFO: `/v3/projects/bcdd554a60d943d1b9a823748a2dc034/users/d68a8359d9ca4610a708f29b7a173afc/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.080935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdd554a60d943d1b9a823748a2dc034, user_id=d68a8359d9ca4610a708f29b7a173afc, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.083556 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee3e63-8775-44b3-9515-1f846408f43b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.087944 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1628ee2a-13dc-48d8-b1bd-3465404ec7f5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.090030 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:28.095722 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1379/2757] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:28 2022] PUT /identity/v3/projects/bcdd554a60d943d1b9a823748a2dc034/users/d68a8359d9ca4610a708f29b7a173afc/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:28.107469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.107742 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.108095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.141472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] MFA Rules not processed for user `d68a8359d9ca4610a708f29b7a173afc`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:28.143445 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.154797 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.155269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.155552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.155821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] PATH_INFO: `/v3/projects/c87a0a5516504a27b3cad44777baad05` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.156985 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87a0a5516504a27b3cad44777baad05)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.158873 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.174377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:28.216572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1380/2758] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:28.228094 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.229730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.288002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c736dc9-696d-4916-9929-1c695251d9f3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.293159 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87a0a5516504a27b3cad44777baad05', 'request_id': 'req-266a1fa3-a3ab-41d1-a235-dd900185d8dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:28.298756 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87a0a5516504a27b3cad44777baad05', 'request_id': 'req-266a1fa3-a3ab-41d1-a235-dd900185d8dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:28.338609 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.339217 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.339529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.339870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.378565 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87a0a5516504a27b3cad44777baad05', 'request_id': 'req-266a1fa3-a3ab-41d1-a235-dd900185d8dd'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:28.392422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:28.392632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] The token cache is being invalidate because project c87a0a5516504a27b3cad44777baad05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:28.392894 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:28.393631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-266a1fa3-a3ab-41d1-a235-dd900185d8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:28.395073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1379/2759] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:28 2022] DELETE /identity/v3/projects/c87a0a5516504a27b3cad44777baad05 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:28.399759 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.404633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.404633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.404850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.404850 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011b02a-070a-4c9e-a3d5-a070ec26db6c service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.413316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1381/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:07:28.419667 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:28.420903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.487410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1380/2761] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:28.496622 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.496908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.497177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.516488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:28.517689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.525739 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1382/2762] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:28.529685 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.539367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c8d7a-3a8a-4a0b-b576-b1aed908df80 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.544629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.545177 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.545462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.545740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.546410 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:28.546718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.548720 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.567240 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1381/2763] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:28.571287 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.571449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.572767 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.581437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9a1ec-5186-457e-b721-f911cf3f89e2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.584648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5f421-3aef-442e-a6cb-aa1384672811 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.586023 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.586614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.586893 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.587165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.587821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.588654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.589282 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.589557 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.589783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.589887 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.591584 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:28.658727 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1382/2764] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:28 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:28.659520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.666585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.668098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.692520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1383/2765] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:07:28.734424 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a1957-6208-42e6-9ef4-38d7d704a810 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.739401 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.740051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.740342 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.740620 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.741290 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.743203 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.756335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:28.870305 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1383/2766] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:28 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:28.873315 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.885522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0239-4446-4b98-be14-d8b545280bf8 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.893342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.893342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.893342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.893342 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.893870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.893870 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.904747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1384/2767] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:28.908817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.920803 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d178755-3878-4946-a5f4-aa1a5b410b73 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.926341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.933334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.933334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.933334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.933334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.933334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c3b76-b40f-4c17-a7e0-796ea2410d6b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:28.942929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1384/2768] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:28.944377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:28.954808 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65dc38-bf77-4900-abf8-a2c35425674a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:28.959407 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:28.960149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:28.960482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:28.960771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] PATH_INFO: `/v3/projects/d896e5a36e5643b8b727076ab14a5de5/users/2a1fa0cda5d34a1f8cf5e73893e1f19f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:28.978191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d896e5a36e5643b8b727076ab14a5de5, user_id=2a1fa0cda5d34a1f8cf5e73893e1f19f, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:28.982098 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.050763 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1385/2769] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:28 2022] PUT /identity/v3/projects/d896e5a36e5643b8b727076ab14a5de5/users/2a1fa0cda5d34a1f8cf5e73893e1f19f/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:29.061836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.062118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.062385 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.094779 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] MFA Rules not processed for user `2a1fa0cda5d34a1f8cf5e73893e1f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:29.095940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.164984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.166750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.168087 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1385/2770] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:29.172582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.239035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042ce0-7a1b-496a-868e-d4c13f854786 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.245343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.246268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.246573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.246852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] PATH_INFO: `/v3/users/8192cd3d8b214b76a3438e5a3535e269` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.247232 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c8035-327c-4e3b-8396-3f4769554938 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.248108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8192cd3d8b214b76a3438e5a3535e269)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.252683 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.252798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.252912 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.253225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.253504 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.254133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.256069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.334405 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1386/2771] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:29 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:29.339106 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.399768 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ac5f7-0a9f-4a64-845a-7bdba1c7fda1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.404923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8192cd3d8b214b76a3438e5a3535e269'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:29.405154 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.407600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.407600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.407600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.407600 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.407992 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:29.408827 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.416792 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:29.503826 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8192cd3d8b214b76a3438e5a3535e269'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:29.504501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8192cd3d8b214b76a3438e5a3535e269'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:29.505161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8192cd3d8b214b76a3438e5a3535e269'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:29.513140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-1b2f7583-21c4-4c94-a0cf-c7bc7007ba10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8192cd3d8b214b76a3438e5a3535e269'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:29.513824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1387/2772] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:29 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:07:29.514662 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.516335 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.528384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6b283-dd92-4594-b000-6ced833be4ba admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.530189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1386/2773] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:29 2022] DELETE /identity/v3/users/8192cd3d8b214b76a3438e5a3535e269 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:29.534328 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.535989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.535989 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.553785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:29.556281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.585712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.586326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.586607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.586881 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.587525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.589264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.599015 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1388/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:29.603417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.613005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37779a7d-b1ca-4512-8473-0cf0a46ca334 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.615441 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1387/2775] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:29.617963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.620269 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.620559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.620838 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] PATH_INFO: `/v3/projects/4cd279d6dbc44c148c7250c07410cf20/users/d6513eaf16f7436b90a48e8508103be8/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.625553 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.626876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.638540 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd279d6dbc44c148c7250c07410cf20, user_id=d6513eaf16f7436b90a48e8508103be8, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.641317 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.684756 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05939d-eeec-48b4-aeef-1164a6e57335 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.688324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.688931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.689213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.689488 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.699377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.700844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.710460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1388/2776] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:07:29.722800 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1389/2777] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:29 2022] PUT /identity/v3/projects/4cd279d6dbc44c148c7250c07410cf20/users/d6513eaf16f7436b90a48e8508103be8/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:07:29.727240 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.738415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32876543-0ebf-4763-9b58-3d8366835c17 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.808947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.809566 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.809896 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.810126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.810794 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.812425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6b845-315c-49eb-b17e-2691e7821f73 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.823771 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1389/2778] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:29.828127 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.839010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e670098-e015-48a5-b4de-cafbc885c73f admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:29.843876 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:29.844559 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.844843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.845202 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] PATH_INFO: `/v3/projects/4cd279d6dbc44c148c7250c07410cf20/users/d6513eaf16f7436b90a48e8508103be8/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.847091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd279d6dbc44c148c7250c07410cf20, user_id=d6513eaf16f7436b90a48e8508103be8, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:29.849772 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:29.860930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1390/2779] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:29 2022] PUT /identity/v3/projects/4cd279d6dbc44c148c7250c07410cf20/users/d6513eaf16f7436b90a48e8508103be8/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:29.873089 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:29.873413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:29.873730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:29.890141 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:29.905003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] MFA Rules not processed for user `d6513eaf16f7436b90a48e8508103be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:29.906331 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:29.982188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1390/2780] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:29.993920 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:29.996664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:30.056734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e0e34-e289-450e-afa7-fc8269e8ea56 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:30.061307 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:30.061910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:30.062187 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:30.062456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:30.064198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:30.123479 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:30.125078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:30.133945 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1391/2781] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:30.157387 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:30.158961 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:30.241104 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398d2cc-b3ad-4356-bcde-b5fbb2997960 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:30.246589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:30.247221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:30.247528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:30.247766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] PATH_INFO: `/v3/projects/029af5aff1664993b868eac1d0244d4b` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:30.248931 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029af5aff1664993b868eac1d0244d4b)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:30.250913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:30.359097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029af5aff1664993b868eac1d0244d4b', 'request_id': 'req-e09d9880-6981-4cb9-b90b-6258d3a23833'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.498690 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029af5aff1664993b868eac1d0244d4b', 'request_id': 'req-e09d9880-6981-4cb9-b90b-6258d3a23833'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.505138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029af5aff1664993b868eac1d0244d4b', 'request_id': 'req-e09d9880-6981-4cb9-b90b-6258d3a23833'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.516460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] The token cache is being invalidate because project 029af5aff1664993b868eac1d0244d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:30.516751 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.517379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.518865 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1391/2782] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:30 2022] DELETE /identity/v3/projects/029af5aff1664993b868eac1d0244d4b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:30.523088 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:30.529215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:30.534899 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991d316-1ec7-45a1-8f70-75a4e08e2666 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:30.592265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:30.592902 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:30.593184 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:30.593460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] PATH_INFO: `/v3/users/d68a8359d9ca4610a708f29b7a173afc` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:30.594615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68a8359d9ca4610a708f29b7a173afc)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:30.596577 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:30.758466 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68a8359d9ca4610a708f29b7a173afc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.800943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68a8359d9ca4610a708f29b7a173afc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.801764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68a8359d9ca4610a708f29b7a173afc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.802391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68a8359d9ca4610a708f29b7a173afc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.815102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-bb5066f3-2fd0-40c6-814e-9cd41ce68ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68a8359d9ca4610a708f29b7a173afc'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:30.833702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1392/2783] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:30 2022] DELETE /identity/v3/users/d68a8359d9ca4610a708f29b7a173afc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:31.213942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.215400 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:31.228652 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09d9880-6981-4cb9-b90b-6258d3a23833 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.248138 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:31.286289 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.286928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.287210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.287484 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] PATH_INFO: `/v3/projects/bcdd554a60d943d1b9a823748a2dc034` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.288646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdd554a60d943d1b9a823748a2dc034)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.290583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.374376 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdd554a60d943d1b9a823748a2dc034', 'request_id': 'req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:31.424033 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdd554a60d943d1b9a823748a2dc034', 'request_id': 'req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:31.430773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdd554a60d943d1b9a823748a2dc034', 'request_id': 'req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:31.442876 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] The token cache is being invalidate because project bcdd554a60d943d1b9a823748a2dc034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:31.443171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:31.443968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-0e9f0776-277b-43e9-b8ec-5bd4cb6da5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:31.445466 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1392/2784] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:31 2022] DELETE /identity/v3/projects/bcdd554a60d943d1b9a823748a2dc034 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:31.450547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.450943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.451288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.472446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:31.473766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:31.533530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1393/2785] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:31.541847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.542201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.542540 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.563787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:31.565065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:31.573456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1393/2786] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:31.577813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.587360 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a29db-68a9-4e64-a510-c98ff7f5595b None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.591903 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.592526 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.592805 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.593076 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.593718 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:31.594024 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.595602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.610994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1394/2787] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:31.611975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.624130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413de9-2d2b-40d7-a7f1-bccc98fcc394 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.630031 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.630628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.630904 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.631174 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.631818 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.633753 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.708996 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1394/2788] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:31 2022] POST /identity/v3/projects => generated 359 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:31.711519 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.720733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176da2d0-ae1c-4695-9109-7e7a82d552a2 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.725423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:31.778065 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.778748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.778986 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.779260 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.779957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.781879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.852508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1395/2789] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:31 2022] POST /identity/v3/users => generated 280 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:31.857245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.871782 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c9e5-ac5f-4bd0-bef4-c38de16ee996 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.873095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.873712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.873998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.874271 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.874919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.876546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.887121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1395/2790] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:31.891156 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.902262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af124ad1-1ef4-4c5d-a982-8168a8ea27d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.907059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.907515 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.908092 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.908194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.908774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.910411 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a622be-d9f3-43ca-9d65-1ab4de4b433e admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:31.925697 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1396/2791] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:31.928941 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:31.939399 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab54d1a-092b-4fb9-8098-2448c38c29c3 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:31.944448 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:31.945101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:31.945386 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:31.945662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] PATH_INFO: `/v3/projects/2b068115a219458faa16af81daece47e/users/259161bb765a4a90bbe7436b87862867/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:31.962210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b068115a219458faa16af81daece47e, user_id=259161bb765a4a90bbe7436b87862867, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:31.966897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:32.062362 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1396/2792] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:31 2022] PUT /identity/v3/projects/2b068115a219458faa16af81daece47e/users/259161bb765a4a90bbe7436b87862867/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:32.072778 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:32.073489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:32.073940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:32.103222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] MFA Rules not processed for user `259161bb765a4a90bbe7436b87862867`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:32.105183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:32.177807 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1397/2793] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:07:32.232830 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:32.234687 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:32.289710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:32.294728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e59f8-091c-4f88-a750-b28c49c224b7 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:32.298544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:32.299159 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:32.299446 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:32.299723 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:32.308884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:32.310317 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6e1a4-8cb3-4d73-b662-2c283e0549e5 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:32.319137 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1397/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:32.336258 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:32.400698 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21cb79-9eff-47ef-911f-3bdd9a43496e None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:32.405283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:32.405942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:32.412664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:32.412664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] PATH_INFO: `/v3/users/259161bb765a4a90bbe7436b87862867` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:32.412664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259161bb765a4a90bbe7436b87862867)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:32.412664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:32.430362 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:32.592741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259161bb765a4a90bbe7436b87862867'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:32.670153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259161bb765a4a90bbe7436b87862867'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:32.671229 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259161bb765a4a90bbe7436b87862867'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:32.671878 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259161bb765a4a90bbe7436b87862867'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:32.679217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259161bb765a4a90bbe7436b87862867'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:32.696869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1398/2795] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:32 2022] DELETE /identity/v3/users/259161bb765a4a90bbe7436b87862867 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:32.701560 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:32.701873 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:32.702169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:32.721772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:32.722968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:32.782216 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1398/2796] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:32.792464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:32.794039 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:32.850217 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec744352-c706-482a-82ad-eb179224bdc7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:32.854468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:32.855072 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:32.855356 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:32.855629 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:32.864544 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:32.865973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:32.875327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1399/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:33.351866 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:33.354173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:33.368867 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c0239-b518-47fa-a6c7-5390bb645e35 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:33.374725 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:33.375422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:33.375705 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:33.376107 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] PATH_INFO: `/v3/projects/2b068115a219458faa16af81daece47e` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:33.377127 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b068115a219458faa16af81daece47e)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:33.379170 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:33.505426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b068115a219458faa16af81daece47e', 'request_id': 'req-8b05f089-43ad-476c-80ac-e8128a1ce242'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:33.567469 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b068115a219458faa16af81daece47e', 'request_id': 'req-8b05f089-43ad-476c-80ac-e8128a1ce242'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:33.580143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b068115a219458faa16af81daece47e', 'request_id': 'req-8b05f089-43ad-476c-80ac-e8128a1ce242'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:33.589432 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] The token cache is being invalidate because project 2b068115a219458faa16af81daece47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:33.589924 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:33.590787 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:33.593210 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1399/2798] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:33 2022] DELETE /identity/v3/projects/2b068115a219458faa16af81daece47e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:35.452542 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:35.453940 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:35.519180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548bfc02-8dfb-493b-9d2c-d39ae54d8d87 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:35.569627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:35.570239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:35.570527 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:35.570840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:35.573562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:35.589395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:35.644591 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:35.646140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ffe92b-54db-4a54-af27-155824535c47 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:35.656943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1400/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:41.695365 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:41.696835 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:41.761377 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f089-43ad-476c-80ac-e8128a1ce242 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:41.767140 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:41.767825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:41.768132 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:41.768405 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] PATH_INFO: `/v3/users/2a1fa0cda5d34a1f8cf5e73893e1f19f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:41.769536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1fa0cda5d34a1f8cf5e73893e1f19f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:41.771470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:41.788775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:42.015775 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1fa0cda5d34a1f8cf5e73893e1f19f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:42.070153 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1fa0cda5d34a1f8cf5e73893e1f19f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:42.071047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1fa0cda5d34a1f8cf5e73893e1f19f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:42.071878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1fa0cda5d34a1f8cf5e73893e1f19f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:42.085168 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1fa0cda5d34a1f8cf5e73893e1f19f'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:42.117075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1400/2800] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:41 2022] DELETE /identity/v3/users/2a1fa0cda5d34a1f8cf5e73893e1f19f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:42.121428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:42.121892 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:42.121995 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:42.142139 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:42.143399 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:42.214465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1401/2801] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:42.224849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:42.226378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:42.325248 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595a171-bcb4-487c-905c-d55416fb19e1 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:42.329074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:42.329772 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:42.330129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:42.330620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:42.345348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:42.347020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:42.359079 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1401/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:43.034435 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:43.035898 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:43.050026 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194db03-64fe-4155-afa3-e764274e5ffb None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:43.055968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:43.055968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:43.055968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:43.056297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] PATH_INFO: `/v3/projects/d896e5a36e5643b8b727076ab14a5de5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:43.057890 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d896e5a36e5643b8b727076ab14a5de5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:43.059363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:43.174583 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd896e5a36e5643b8b727076ab14a5de5', 'request_id': 'req-18d4df54-fd46-4c33-a2a3-9502ec06535a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.186655 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd896e5a36e5643b8b727076ab14a5de5', 'request_id': 'req-18d4df54-fd46-4c33-a2a3-9502ec06535a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.252887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd896e5a36e5643b8b727076ab14a5de5', 'request_id': 'req-18d4df54-fd46-4c33-a2a3-9502ec06535a'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.265124 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] The token cache is being invalidate because project d896e5a36e5643b8b727076ab14a5de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:43.265416 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.266073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.267550 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1402/2803] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:43 2022] DELETE /identity/v3/projects/d896e5a36e5643b8b727076ab14a5de5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:43.271947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:43.283608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fcdab-9048-4df0-ac11-e4af902a54c7 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:43.367379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:43.368053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:43.368499 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:43.368829 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] PATH_INFO: `/v3/users/d6513eaf16f7436b90a48e8508103be8` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:43.369952 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6513eaf16f7436b90a48e8508103be8)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:43.372017 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:43.588418 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:43.598163 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6513eaf16f7436b90a48e8508103be8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.709956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6513eaf16f7436b90a48e8508103be8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.714880 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6513eaf16f7436b90a48e8508103be8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.716080 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6513eaf16f7436b90a48e8508103be8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.725577 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-e858a068-a784-483b-829c-e0cb99b42977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6513eaf16f7436b90a48e8508103be8'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:43.752314 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1402/2804] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:43 2022] DELETE /identity/v3/users/d6513eaf16f7436b90a48e8508103be8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:44.312066 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:44.313555 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:44.326516 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4df54-fd46-4c33-a2a3-9502ec06535a admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:44.356426 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:44.400157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:44.400818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.401163 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.401488 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] PATH_INFO: `/v3/projects/4cd279d6dbc44c148c7250c07410cf20` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.402740 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd279d6dbc44c148c7250c07410cf20)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:44.404755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:44.495367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd279d6dbc44c148c7250c07410cf20', 'request_id': 'req-683635fc-6ffd-4843-ab57-6b393d7b428f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:44.501676 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd279d6dbc44c148c7250c07410cf20', 'request_id': 'req-683635fc-6ffd-4843-ab57-6b393d7b428f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:44.549664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd279d6dbc44c148c7250c07410cf20', 'request_id': 'req-683635fc-6ffd-4843-ab57-6b393d7b428f'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:44.562743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] The token cache is being invalidate because project 4cd279d6dbc44c148c7250c07410cf20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:44.563273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:44.563947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-683635fc-6ffd-4843-ab57-6b393d7b428f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:44.565530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1403/2805] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:44 2022] DELETE /identity/v3/projects/4cd279d6dbc44c148c7250c07410cf20 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:44.571551 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.572108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.572108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.593588 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:44.594840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:44.662111 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1403/2806] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:44.670746 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.671035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.671314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.695833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:44.697112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:44.705448 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1404/2807] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:44.712110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:44.728526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f2bdd-2cc5-415c-931d-09c7412428a3 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:44.734384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:44.734979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.735258 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.735528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.736224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:44.736525 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:44.738148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:44.753948 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1404/2808] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:44.755115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:44.764785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225897c5-942a-4b9b-afb3-809485610dbe None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:44.769421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:44.770025 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.770303 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.770573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.771375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:44.773696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:44.894853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1405/2809] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:44 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:44.899091 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:44.910956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598e2c0-1f9b-48d0-a38e-3f0f4a6f5a4d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:44.970020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:44.970571 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:44.970968 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:44.971246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:44.971939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:44.974102 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:45.045805 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1405/2810] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:44 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:45.047180 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:45.058161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d7a34-c889-4588-a0ec-701e63d64ca7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:45.063493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:45.064188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:45.064579 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:45.064861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:45.067972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:45.067972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:45.078304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1406/2811] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:45.082467 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:45.092625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e5db2-2a3d-4123-aba3-29f7f6dc1fd9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:45.097350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:45.097984 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:45.098270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:45.098544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:45.099191 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:45.100825 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f197f-2382-41e7-9924-c5375b1d7bf3 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:45.116169 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1406/2812] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:45.117450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:45.130696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7ce5-af08-4c47-923f-f12b237f9af4 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:45.135352 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:45.136101 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:45.136361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:45.136632 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] PATH_INFO: `/v3/projects/c6c36de39f134101a51ed74416930e56/users/7d1c0a24165c4b58ab0cabe24c945e74/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:45.152293 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c36de39f134101a51ed74416930e56, user_id=7d1c0a24165c4b58ab0cabe24c945e74, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:45.154562 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:45.260590 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1407/2813] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:45 2022] PUT /identity/v3/projects/c6c36de39f134101a51ed74416930e56/users/7d1c0a24165c4b58ab0cabe24c945e74/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:45.271012 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:45.271304 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:45.271585 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:45.307531 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] MFA Rules not processed for user `7d1c0a24165c4b58ab0cabe24c945e74`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:45.308872 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:45.319530 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:45.398615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1407/2814] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:45.411103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:45.412907 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:45.504132 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16b5255-e3ad-403d-af0b-83869299e114 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:45.517150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:45.517773 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:45.518086 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:45.518361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:45.527246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:45.529254 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:45.533297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:45.539743 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1408/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:47.689689 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:47.693300 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:47.780513 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88aadf-e861-4b16-9fea-725afab7a9e8 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:47.784489 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:47.785178 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:47.785520 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:47.785859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:47.787740 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:47.863299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:47.864857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:47.875077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1408/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:48.517887 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:48.520200 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:48.535641 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7773f64-25d4-4489-aee7-d89e9db64ce1 service cinder] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:48.540458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:48.541143 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:48.541430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:48.541726 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] PATH_INFO: `/v3/users/7ebbc532f3194302a58bb0e133124d36` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:48.542980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ebbc532f3194302a58bb0e133124d36)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:48.545514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:48.705754 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ebbc532f3194302a58bb0e133124d36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:48.789821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ebbc532f3194302a58bb0e133124d36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:48.790450 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ebbc532f3194302a58bb0e133124d36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:48.791064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ebbc532f3194302a58bb0e133124d36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:48.799649 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ebbc532f3194302a58bb0e133124d36'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:48.818138 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1409/2817] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:48 2022] DELETE /identity/v3/users/7ebbc532f3194302a58bb0e133124d36 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:49.049549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:49.057897 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4249d8-d072-4cd0-b0d6-edbe4f90de94 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:49.121970 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:49.122654 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:49.122935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:49.123205 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] PATH_INFO: `/v3/projects/0a890bc7150149a8a4ff5b701b34f487` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:49.124379 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a890bc7150149a8a4ff5b701b34f487)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:49.126348 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:49.128684 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:49.224542 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a890bc7150149a8a4ff5b701b34f487', 'request_id': 'req-41d01b78-3f4b-4b08-a013-616bb9409489'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.286889 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a890bc7150149a8a4ff5b701b34f487', 'request_id': 'req-41d01b78-3f4b-4b08-a013-616bb9409489'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.293118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a890bc7150149a8a4ff5b701b34f487', 'request_id': 'req-41d01b78-3f4b-4b08-a013-616bb9409489'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.305288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] The token cache is being invalidate because project 0a890bc7150149a8a4ff5b701b34f487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:49.305611 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.306246 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.307755 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1409/2818] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:49 2022] DELETE /identity/v3/projects/0a890bc7150149a8a4ff5b701b34f487 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:49.311861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:49.313283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:49.327264 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb49be5-46ed-44d7-b740-dcd21410e2d7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:49.385273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:49.385908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:49.386188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:49.386459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] PATH_INFO: `/v3/users/0ad30cca9e1049a8b5902cc5ec301539` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:49.387674 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad30cca9e1049a8b5902cc5ec301539)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:49.390130 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:49.530896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad30cca9e1049a8b5902cc5ec301539'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.595428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad30cca9e1049a8b5902cc5ec301539'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.596071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad30cca9e1049a8b5902cc5ec301539'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.596712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad30cca9e1049a8b5902cc5ec301539'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.604246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad30cca9e1049a8b5902cc5ec301539'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:49.611471 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:49.623078 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1410/2819] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:49 2022] DELETE /identity/v3/users/0ad30cca9e1049a8b5902cc5ec301539 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:49.928583 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:49.931339 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:49.947065 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d01b78-3f4b-4b08-a013-616bb9409489 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:50.016913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:50.016913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:50.016913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:50.016913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] PATH_INFO: `/v3/projects/684451d979d34edf8eee84fd1cc28be2` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:50.017341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684451d979d34edf8eee84fd1cc28be2)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:50.018982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:50.133741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684451d979d34edf8eee84fd1cc28be2', 'request_id': 'req-55ac557e-4c9e-42f1-a3b5-889ff3585900'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:50.206998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684451d979d34edf8eee84fd1cc28be2', 'request_id': 'req-55ac557e-4c9e-42f1-a3b5-889ff3585900'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:50.213281 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684451d979d34edf8eee84fd1cc28be2', 'request_id': 'req-55ac557e-4c9e-42f1-a3b5-889ff3585900'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:50.224630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] The token cache is being invalidate because project 684451d979d34edf8eee84fd1cc28be2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:50.224923 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:50.225554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-55ac557e-4c9e-42f1-a3b5-889ff3585900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:50.227028 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1410/2820] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:49 2022] DELETE /identity/v3/projects/684451d979d34edf8eee84fd1cc28be2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:52.456045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:52.457524 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:52.470298 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a7a5d-1d11-4640-8c45-f7bbcfd9a1b8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:52.525198 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:52.525820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:52.526097 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:52.526369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] PATH_INFO: `/v3/users/7d1c0a24165c4b58ab0cabe24c945e74` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:52.527468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1c0a24165c4b58ab0cabe24c945e74)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:52.529454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:52.705745 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1c0a24165c4b58ab0cabe24c945e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:52.766439 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1c0a24165c4b58ab0cabe24c945e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:52.767045 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1c0a24165c4b58ab0cabe24c945e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:52.767640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1c0a24165c4b58ab0cabe24c945e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:52.774958 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1c0a24165c4b58ab0cabe24c945e74'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:52.793118 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1411/2821] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:52 2022] DELETE /identity/v3/users/7d1c0a24165c4b58ab0cabe24c945e74 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:52.798115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:52.798638 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:52.798736 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:52.817409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:52.818612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:52.834884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:52.880242 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1411/2822] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:52.889931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:52.891326 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:52.947925 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa55a9f-19f2-498f-9af9-a39b327d32a6 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:52.951824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:52.952449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:52.952729 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:52.953005 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:52.961905 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:52.963265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a6c8c-91a0-4898-8e8c-cf68b5891d22 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:52.973075 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1412/2823] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:53.477580 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:53.480202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:53.491234 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df67072-c29e-47c4-8a8b-943414b7bd48 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:53.496590 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:53.497370 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:53.498209 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:53.498567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] PATH_INFO: `/v3/projects/c6c36de39f134101a51ed74416930e56` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:53.499741 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c36de39f134101a51ed74416930e56)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:53.501846 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:53.585199 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c36de39f134101a51ed74416930e56', 'request_id': 'req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:53.646776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c36de39f134101a51ed74416930e56', 'request_id': 'req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:53.652648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c36de39f134101a51ed74416930e56', 'request_id': 'req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:53.663863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] The token cache is being invalidate because project c6c36de39f134101a51ed74416930e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:53.664181 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:53.664815 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-21e2f4d7-099b-4bf4-8ede-0d7f73952f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:53.666301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1412/2824] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:53 2022] DELETE /identity/v3/projects/c6c36de39f134101a51ed74416930e56 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:53.671215 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:53.671713 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:53.681693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:53.691760 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:53.692972 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:53.698161 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:53.751872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1413/2825] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:53.761202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:53.761494 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:53.761859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:53.782259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:53.783568 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:53.791515 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1413/2826] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:53.796430 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:53.807901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc944887-7eb5-49cf-a37d-c7168c6ff592 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:53.814016 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:53.817043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:53.817043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:53.817043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:53.817043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:53.817043 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:53.817934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:53.830112 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1414/2827] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:53.834510 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:53.843717 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f9ebda-1c30-412f-b1d6-ebcba9bc4239 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:53.848517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:53.849112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:53.849391 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:53.849664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:53.850297 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:53.852326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:53.951249 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1414/2828] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:53 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:53.955523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:53.965429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2217494-b49d-4f56-8723-abd46034eba7 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:54.021412 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:54.022019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.022297 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.022576 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.023233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:54.025160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:54.104595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1415/2829] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:53 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:54.109415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:54.119702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b166d-b161-429a-b365-aca85c7169b9 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:54.125078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:54.125724 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.126003 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.126278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.126919 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:54.128532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:54.138299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1415/2830] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:54.142069 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:54.151783 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a160cd80-d3eb-40e0-9285-f83195ba09b1 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:54.156585 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:54.157194 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.157476 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.157748 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.158487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:54.160170 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca27da-3409-4d47-89c9-cfd4aa82ab29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:54.171103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1416/2831] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:54.174964 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:54.184625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6f8f6-2635-4ea1-8487-208a2492eb75 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:54.189785 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:54.190417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.190696 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.190969 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] PATH_INFO: `/v3/projects/cd87d360401544169237a126b8a48658/users/3bc6fe4d97fa4e3aba11b8c1ba266e10/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.205417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd87d360401544169237a126b8a48658, user_id=3bc6fe4d97fa4e3aba11b8c1ba266e10, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:54.208088 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:54.292935 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1416/2832] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:54 2022] PUT /identity/v3/projects/cd87d360401544169237a126b8a48658/users/3bc6fe4d97fa4e3aba11b8c1ba266e10/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:54.303901 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.304220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.304496 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.332146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] MFA Rules not processed for user `3bc6fe4d97fa4e3aba11b8c1ba266e10`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:54.333369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:54.399706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1417/2833] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:54.411326 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:54.413057 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:54.472309 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:54.477608 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33efa8b-41f9-48b7-ae4d-49ab1027fd9a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:54.481320 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:54.484175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:54.484175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:54.484175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:54.492291 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:54.493714 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e750cb-e112-41b9-ab5a-1121daa7d923 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:54.502786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1417/2834] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:55.724869 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:55.728716 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:55.736580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:55.791765 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a69fc-7ce7-4577-8af1-e5494a2d4700 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:55.796884 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:55.797511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:55.797819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:55.798089 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] PATH_INFO: `/v3/users/c6d4efa2b8a94f6db54b52b7b7799d56` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:55.799185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d4efa2b8a94f6db54b52b7b7799d56)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:55.801150 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:55.957552 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d4efa2b8a94f6db54b52b7b7799d56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:56.041205 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d4efa2b8a94f6db54b52b7b7799d56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:56.041825 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d4efa2b8a94f6db54b52b7b7799d56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:56.042428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d4efa2b8a94f6db54b52b7b7799d56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:56.050263 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d4efa2b8a94f6db54b52b7b7799d56'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:56.067099 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1418/2835] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:07:55 2022] DELETE /identity/v3/users/c6d4efa2b8a94f6db54b52b7b7799d56 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:56.071589 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:56.072090 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:56.072189 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:56.092126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:56.093344 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:56.150131 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1418/2836] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:56.160437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:56.161854 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:56.219810 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3c9db-a218-45a5-94d4-ef081924efbf admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:56.223462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:56.224094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:56.224372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:56.224644 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:56.234141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:56.235564 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7b2a0-1769-4f3a-ac7d-abf638902b3c service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:56.245549 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1419/2837] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:07:56.694677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:56.696136 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:56.711047 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0cc6b-8b97-4db0-99bc-46a4b8459386 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:56.715697 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:56.716383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:56.716648 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:56.716920 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] PATH_INFO: `/v3/projects/be22d0b07fe346cebd38321744aa4c53` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:56.718058 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be22d0b07fe346cebd38321744aa4c53)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:56.720223 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:56.990462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be22d0b07fe346cebd38321744aa4c53', 'request_id': 'req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:57.057942 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be22d0b07fe346cebd38321744aa4c53', 'request_id': 'req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:57.064658 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be22d0b07fe346cebd38321744aa4c53', 'request_id': 'req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:57.076077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] The token cache is being invalidate because project be22d0b07fe346cebd38321744aa4c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:07:57.076709 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:57.076999 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-890c7d6a-2112-4a08-b4a8-23bd0017c0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:07:57.078482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1419/2838] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:07:56 2022] DELETE /identity/v3/projects/be22d0b07fe346cebd38321744aa4c53 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:57.083493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.083931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.084095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.103339 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:57.104568 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:57.129308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:57.163849 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1420/2839] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:57.173293 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.173678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.174015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.194898 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:57.196195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:57.204764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1420/2840] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:57.209173 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.219020 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b300ce8-6a01-4371-8b64-5953c12ce417 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.223709 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.224394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.224673 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.224947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.225617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:07:57.225929 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.227525 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.239395 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1421/2841] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:07:57.243734 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.253482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809324ad-048a-495f-b4e2-21c37d51b7a1 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.258218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.264152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.264152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.264152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.264152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.264152 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.345637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1421/2842] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:07:57 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:57.349593 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.361219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce309f-aced-46c3-b7b9-10442ff462a9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.416245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.416770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.417048 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.417319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.417947 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.420603 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.487314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1422/2843] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:07:57 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:07:57.491629 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.502765 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729ac1-fd25-4b7c-afe7-d6fb2f2ba38a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.506481 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.507078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.507355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.507626 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.508298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.509878 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.519750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1422/2844] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:07:57.523578 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.534091 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe26a8-1842-43ec-a59f-2ca9165d8f6d admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.538774 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.539367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.539645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.539926 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.540573 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.542152 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34713d8-0915-4f91-b4c6-eec7da11686d admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.553311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1423/2845] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:07:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:07:57.557278 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.567015 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc1f74-7634-484f-8f52-e31bd6843d2a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.571502 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.572171 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.572451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.572720 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] PATH_INFO: `/v3/projects/3886d8eb46324551998fe94bf695f3f2/users/ac19ede602074b038a47be046800ad0b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.587549 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3886d8eb46324551998fe94bf695f3f2, user_id=ac19ede602074b038a47be046800ad0b, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.590243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.686917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1423/2846] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:07:57 2022] PUT /identity/v3/projects/3886d8eb46324551998fe94bf695f3f2/users/ac19ede602074b038a47be046800ad0b/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:07:57.702111 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.702398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.702704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.732464 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] MFA Rules not processed for user `ac19ede602074b038a47be046800ad0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:07:57.733750 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:57.798964 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1424/2847] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:07:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:07:57.809711 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:07:57.811413 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:07:57.817796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:07:57.868715 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4a0ff-eaec-49e9-af90-6e7bad12a155 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:07:57.872375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:07:57.872982 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:07:57.873259 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:07:57.873529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:07:57.882832 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:07:57.884630 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:07:57.893900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1424/2848] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:07:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:07.796109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=86,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:08.104323 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=24 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:09.072706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:09.134040 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb9c0-4e89-48fb-bfd6-10b6cb082911 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:09.138587 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:09.139209 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.139497 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.139771 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] PATH_INFO: `/v3/users/ac19ede602074b038a47be046800ad0b` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.140930 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac19ede602074b038a47be046800ad0b)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:09.142843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:09.327882 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:09.329333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:09.342947 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2d0db-2714-43e4-9fa1-a80cd00db259 service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:09.347933 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:09.348582 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.348864 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.349166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] PATH_INFO: `/v3/users/3bc6fe4d97fa4e3aba11b8c1ba266e10` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.350299 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc6fe4d97fa4e3aba11b8c1ba266e10)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:09.352899 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:09.360160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac19ede602074b038a47be046800ad0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.428888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac19ede602074b038a47be046800ad0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.429499 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac19ede602074b038a47be046800ad0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.430123 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac19ede602074b038a47be046800ad0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.437473 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-08357abf-aafb-43e6-997a-13c4baf266ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac19ede602074b038a47be046800ad0b'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.455094 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1425/2849] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:08:09 2022] DELETE /identity/v3/users/ac19ede602074b038a47be046800ad0b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:08:09.459822 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.460141 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.460421 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.479462 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:09.480764 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:09.536785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1426/2850] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:09.546371 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:09.547658 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:09.568633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:09.569303 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc6fe4d97fa4e3aba11b8c1ba266e10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.605631 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5b8bb2-0e68-4498-8390-13ee48afd60d None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:09.609444 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:09.610051 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.610363 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.610633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.620142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:09.621575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39afd701-389b-490a-a83b-64ceb015fdc2 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:09.623672 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc6fe4d97fa4e3aba11b8c1ba266e10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.624347 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc6fe4d97fa4e3aba11b8c1ba266e10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.624962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc6fe4d97fa4e3aba11b8c1ba266e10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.633265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc6fe4d97fa4e3aba11b8c1ba266e10'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:09.634010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1427/2851] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:08:09.652437 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1425/2852] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:08:09 2022] DELETE /identity/v3/users/3bc6fe4d97fa4e3aba11b8c1ba266e10 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:08:09.657455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.657747 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.658052 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.682285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:09.683604 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:09.746900 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1428/2853] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:09.757084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:09.758599 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:09.815139 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319983f-ea26-436a-870a-6fb3c4e12843 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:09.819516 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:09.820097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:09.820383 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:09.820666 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:09.830401 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:09.831848 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:09.841507 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1426/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:10.015189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.017107 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.030808 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc0292-5391-47b9-864d-0a05f92841f8 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.037445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.038145 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.038493 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.038835 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] PATH_INFO: `/v3/projects/3886d8eb46324551998fe94bf695f3f2` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.040967 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3886d8eb46324551998fe94bf695f3f2)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.043841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.156830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3886d8eb46324551998fe94bf695f3f2', 'request_id': 'req-164ab386-6008-4fa2-b974-d5e9ceeadd11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.164397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3886d8eb46324551998fe94bf695f3f2', 'request_id': 'req-164ab386-6008-4fa2-b974-d5e9ceeadd11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.222359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.222359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.235480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0b40e-18fe-4fdf-849c-fbdf24d31a70 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.241117 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3886d8eb46324551998fe94bf695f3f2', 'request_id': 'req-164ab386-6008-4fa2-b974-d5e9ceeadd11'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.254924 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] The token cache is being invalidate because project 3886d8eb46324551998fe94bf695f3f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:08:10.255288 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.256115 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-164ab386-6008-4fa2-b974-d5e9ceeadd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.257843 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1429/2855] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:08:10 2022] DELETE /identity/v3/projects/3886d8eb46324551998fe94bf695f3f2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:08:10.262454 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47444f-65e3-4e46-8bc1-b556d9c5cee8 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.262826 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47444f-65e3-4e46-8bc1-b556d9c5cee8 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.263149 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd47444f-65e3-4e46-8bc1-b556d9c5cee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.283561 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-cd47444f-65e3-4e46-8bc1-b556d9c5cee8 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:10.285417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-cd47444f-65e3-4e46-8bc1-b556d9c5cee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.298946 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.299586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.299901 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.300206 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] PATH_INFO: `/v3/projects/cd87d360401544169237a126b8a48658` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.301356 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd87d360401544169237a126b8a48658)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.303349 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.323279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:10.332377 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:10.351659 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1430/2856] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:10.408954 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd87d360401544169237a126b8a48658', 'request_id': 'req-ffada7ad-2c47-489e-9b8c-d9729c5d794a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.414415 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.414706 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.414984 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.433888 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:10.435081 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.469928 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd87d360401544169237a126b8a48658', 'request_id': 'req-ffada7ad-2c47-489e-9b8c-d9729c5d794a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.476745 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd87d360401544169237a126b8a48658', 'request_id': 'req-ffada7ad-2c47-489e-9b8c-d9729c5d794a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.488134 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] The token cache is being invalidate because project cd87d360401544169237a126b8a48658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:08:10.488422 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.489055 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ffada7ad-2c47-489e-9b8c-d9729c5d794a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:10.490528 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1427/2857] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:08:10 2022] DELETE /identity/v3/projects/cd87d360401544169237a126b8a48658 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:08:10.494968 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1431/2858] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:10.495215 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330778c-01d9-4b6a-816a-d577d7a41718 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.495501 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330778c-01d9-4b6a-816a-d577d7a41718 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.495779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330778c-01d9-4b6a-816a-d577d7a41718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.499031 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.508179 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64930d53-5068-43f4-9ed9-48bbfb9a0596 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.512833 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.513437 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.513717 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.513993 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.514634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81863) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:08:10.514955 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.516195 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-e330778c-01d9-4b6a-816a-d577d7a41718 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:10.516574 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.517404 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-e330778c-01d9-4b6a-816a-d577d7a41718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.525939 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1428/2859] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:10.528755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1432/2860] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:08:10.535336 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.535620 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.535893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.537957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.547823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b75c1-2fbe-49cd-9d21-bada79ce4a7c admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.552501 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.553098 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.557543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.557543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.557543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.557543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.557934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:10.557934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:10.566037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1429/2861] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:10.570118 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.580078 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a32ac-9fe6-4b36-9f4b-5beca2a7fb50 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.586266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.586266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.586545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.586814 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.587452 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:08:10.587750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.589409 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.601375 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1430/2862] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 23 14:08:10.609213 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.615694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270c3f6-c41a-43a3-8ceb-8ca84efffa5b admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.620472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.621038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.621355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.621632 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] PATH_INFO: `/v3/projects` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.622245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.624226 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.631301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1433/2863] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:08:10.635472 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.696186 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133dbdf-8654-4475-a0c3-2a04ddb23760 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.701095 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.701693 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.701973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.702245 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] PATH_INFO: `/v3/users` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.702868 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.704817 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.714480 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1431/2864] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:08:10.716461 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.776913 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802d494-0c7c-42b0-afd1-9cb871ecf85a admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.781754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.782355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.782661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.782934 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.783693 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.786186 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.801910 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1434/2865] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:08:10.805836 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.815551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03555ee7-74f0-4a17-8f0b-bddf014e6a37 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.820301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.820879 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.821160 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.821433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.822059 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.823638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.833789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1435/2866] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:08:10.842440 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.852211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95610cb-1241-4399-8785-506ac02e1ff5 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.856734 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.857282 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.857563 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.857837 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.858436 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.860019 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.870723 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1436/2867] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:08:10.874373 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.883468 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1271d-9463-46fc-9c62-12bf657f4261 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.888027 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.888640 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.888922 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.889195 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] PATH_INFO: `/v3/projects/55605cf56d48462587bd9c470502d448/users/396eaff430de42cf921ae7c2c87c645c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.892764 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1432/2868] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:08:10.896266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.903770 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55605cf56d48462587bd9c470502d448, user_id=396eaff430de42cf921ae7c2c87c645c, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.906026 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b81916-9499-4f18-ab12-b6a571ff1250 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.906446 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ae8b3-4f0b-4145-a448-e45601011f97 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.910394 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:10.911427 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.912061 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.912341 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.912612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.913245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.914857 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.925451 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1433/2869] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:08:10.929063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.938522 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80738211-6738-480c-8368-a53ba9a3b3ab admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.943221 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.943766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.944084 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.944357 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.944959 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.946485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:10.957415 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1434/2870] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 23 14:08:10.961175 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:10.970166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1015a1-aeec-433f-bb2c-791b346b68e8 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:10.975288 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:10.977728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.977728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.977728 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] PATH_INFO: `/v3/projects/ea32217f7b0b4daa8347106869477f0f/users/20ca766bab104c3ca68f668c9b733a5c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.979063 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1437/2871] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:08:10 2022] PUT /identity/v3/projects/55605cf56d48462587bd9c470502d448/users/396eaff430de42cf921ae7c2c87c645c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:08:10.983991 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:10.984285 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:10.984994 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:10.991364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea32217f7b0b4daa8347106869477f0f, user_id=20ca766bab104c3ca68f668c9b733a5c, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:10.994093 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aca1fa-fe25-41dc-ab86-5e309f685cbc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:11.005594 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:11.006897 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:11.064456 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1438/2872] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:11.071044 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:11.074266 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:11.075614 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:11.076470 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1435/2873] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:08:10 2022] PUT /identity/v3/projects/ea32217f7b0b4daa8347106869477f0f/users/20ca766bab104c3ca68f668c9b733a5c/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 23 14:08:11.099439 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:11.099730 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:11.100038 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:11.126998 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] MFA Rules not processed for user `20ca766bab104c3ca68f668c9b733a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:11.128149 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:11.133449 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b9c3d3-db54-4370-bde7-2aa75f5f4a0f None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:11.181283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:11.181931 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:11.182185 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:11.182460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:11.194035 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1436/2874] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:11.207072 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:11.213388 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:11.244271 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:11.245702 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7f514-efdf-4eb1-9fd7-b4fe8dcea01b service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:11.256896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1439/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:08:11.266294 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6c81d-2fb5-4c87-bbfb-a9d9297a3c66 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:11.271567 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:11.272250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:11.272534 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:11.272806 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:11.281776 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:11.283254 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:11.292967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1437/2876] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:08:12.359645 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11e6-91df-43de-ad8f-d6941c4ef4aa None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:12.360250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11e6-91df-43de-ad8f-d6941c4ef4aa None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:12.361664 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af11e6-91df-43de-ad8f-d6941c4ef4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:12.369820 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=100 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:12.395455 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-08af11e6-91df-43de-ad8f-d6941c4ef4aa None None] MFA Rules not processed for user `396eaff430de42cf921ae7c2c87c645c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:12.396766 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-08af11e6-91df-43de-ad8f-d6941c4ef4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:12.472077 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1440/2877] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 23 14:08:12.484283 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:12.485804 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:12.550967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65091e2-a9f9-4342-80cf-8e5b1c727d48 service glance] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:12.554803 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '983535804007417db2c2f7727e70cda7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:12.555440 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:12.555721 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:12.556027 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:12.565250 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:12.566774 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:12.576625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1438/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:14.143487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:14.144483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:14.144648 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:14.165013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] MFA Rules not processed for user `396eaff430de42cf921ae7c2c87c645c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:14.166225 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:14.172980 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1441/2879] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:22.572244 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=84 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:24.158452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=34 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:33.216207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:33.218884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:33.359844 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446936-3842-48dc-b91b-5c5cae15467a service cinder] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:33.365633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:33.366425 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:33.366707 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:33.366977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:33.368750 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:33.380559 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:33.382678 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269ba6d-67f1-4b16-ac2b-0022b9ba654d service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:33.393604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1439/2880] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:36.188369 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:36.235458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32803a61-d4ee-435d-8bd0-021add6f0572 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:36.240064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:36.240704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:36.240973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:36.241330 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] PATH_INFO: `/v3/users/20ca766bab104c3ca68f668c9b733a5c` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:36.242607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ca766bab104c3ca68f668c9b733a5c)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:36.244707 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:36.450445 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ca766bab104c3ca68f668c9b733a5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:36.566841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ca766bab104c3ca68f668c9b733a5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:36.567502 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ca766bab104c3ca68f668c9b733a5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:36.568144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ca766bab104c3ca68f668c9b733a5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:36.576870 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ca766bab104c3ca68f668c9b733a5c'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:36.594175 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1442/2881] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:08:36 2022] DELETE /identity/v3/users/20ca766bab104c3ca68f668c9b733a5c => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:08:36.598625 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:36.599125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:36.599286 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:36.641157 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:36.642426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:36.702505 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1440/2882] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:36.712311 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:36.713829 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:36.771331 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96b3b-c2d9-47bc-a31b-b56dd59b7dae admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:36.774860 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:36.775749 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:36.776035 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:36.776308 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:36.785489 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:36.786932 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002bbd-3ce4-459b-9b95-9f4afe001351 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:36.797250 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1443/2883] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:08:37.224260 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:37.225770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:37.238097 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=100 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:37.247554 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344875c-ddad-4dd8-be13-b47501317da0 None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:37.253532 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:37.254188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:37.254533 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:37.254726 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] PATH_INFO: `/v3/projects/ea32217f7b0b4daa8347106869477f0f` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:37.255852 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea32217f7b0b4daa8347106869477f0f)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:37.257853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:37.371456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea32217f7b0b4daa8347106869477f0f', 'request_id': 'req-756e208d-90fc-4efb-99e5-7857d7a8a728'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:37.445579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea32217f7b0b4daa8347106869477f0f', 'request_id': 'req-756e208d-90fc-4efb-99e5-7857d7a8a728'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:37.452046 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea32217f7b0b4daa8347106869477f0f', 'request_id': 'req-756e208d-90fc-4efb-99e5-7857d7a8a728'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:37.465227 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] The token cache is being invalidate because project ea32217f7b0b4daa8347106869477f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81864) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:08:37.465550 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:37.466145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:08:37.467976 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1441/2884] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:08:37 2022] DELETE /identity/v3/projects/ea32217f7b0b4daa8347106869477f0f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:08:46.182071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd0d-283f-4d27-b155-4341c99def2c None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:46.182589 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd0d-283f-4d27-b155-4341c99def2c None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:46.182712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dd0d-283f-4d27-b155-4341c99def2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:46.230350 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1922dd0d-283f-4d27-b155-4341c99def2c None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:46.231543 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1922dd0d-283f-4d27-b155-4341c99def2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:46.244520 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:08:46.291517 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1444/2885] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:46.307115 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:46.308519 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:46.409628 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e208d-90fc-4efb-99e5-7857d7a8a728 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:46.417243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:46.417849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:46.418247 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:46.418518 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:46.426578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:46.428207 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:46.437991 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1442/2886] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:50.538102 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ae04-3138-4118-9db4-de810b29e5ba None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:50.538575 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ae04-3138-4118-9db4-de810b29e5ba None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:50.538710 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ae04-3138-4118-9db4-de810b29e5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:50.558560 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-4b45ae04-3138-4118-9db4-de810b29e5ba None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:50.559751 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-4b45ae04-3138-4118-9db4-de810b29e5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:50.567383 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1445/2887] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:50.581990 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:50.583385 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:50.597562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1878890-a7e5-4cde-bdb5-e69e5c625c63 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:50.603202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:50.603796 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:50.604108 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:50.604381 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:50.612433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:50.614016 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:50.623641 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1443/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:53.954853 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f83e-62e8-4d89-a22b-bd36746d1a3a None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:53.955452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f83e-62e8-4d89-a22b-bd36746d1a3a None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:53.955452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8f83e-62e8-4d89-a22b-bd36746d1a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:53.974458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-ecb8f83e-62e8-4d89-a22b-bd36746d1a3a None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:53.975647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-ecb8f83e-62e8-4d89-a22b-bd36746d1a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:53.983769 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1446/2889] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:08:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:53.999393 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:54.010527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447aa8-9cb1-4c5d-bab6-9efca3b1fb9d service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:54.015979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:54.016572 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:54.016853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:54.017126 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:54.025092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:54.026662 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:54.036637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1444/2890] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:08:56.872681 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfb07-5c54-4a1f-978f-b6e514d292ce None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:56.873146 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfb07-5c54-4a1f-978f-b6e514d292ce None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:56.873270 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bfb07-5c54-4a1f-978f-b6e514d292ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:56.892927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-a65bfb07-5c54-4a1f-978f-b6e514d292ce None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:08:56.894142 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a65bfb07-5c54-4a1f-978f-b6e514d292ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:08:56.902547 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1447/2891] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:08:56.917545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:08:56.928643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965826fd-e150-42cb-901c-087c5d4f8f75 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:08:56.934645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:08:56.935245 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:08:56.935526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:08:56.935799 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:08:56.943770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:08:56.945374 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:08:56.955869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1445/2892] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:08:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:00.128397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbf78-8a5a-4ada-b30c-6f3fa61b7066 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:00.128949 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbf78-8a5a-4ada-b30c-6f3fa61b7066 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:00.129119 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbf78-8a5a-4ada-b30c-6f3fa61b7066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:00.148635 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-41edbf78-8a5a-4ada-b30c-6f3fa61b7066 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:00.150460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-41edbf78-8a5a-4ada-b30c-6f3fa61b7066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:00.158071 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1448/2893] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:00.173823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:00.185162 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b82a1-9a02-4dd2-95bf-9fca04eb6c78 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:00.190670 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:00.191298 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:00.191578 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:00.191849 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:00.197450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:00.201419 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:00.202978 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:00.213296 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1446/2894] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:03.365133 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c474-0de5-429d-a2b4-40a3a44060b4 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:03.365602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c474-0de5-429d-a2b4-40a3a44060b4 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:03.365724 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c474-0de5-429d-a2b4-40a3a44060b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:03.385798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-0ae8c474-0de5-429d-a2b4-40a3a44060b4 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:03.388939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-0ae8c474-0de5-429d-a2b4-40a3a44060b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:03.395105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1449/2895] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:03.410604 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:03.421786 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3bb5e-7a1d-4a69-b9c0-69385ee8d8b8 service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:03.427197 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:03.427884 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:03.428201 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:03.428479 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:03.437037 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:03.438562 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cc05f-8107-4e26-b253-f555744157c4 service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:03.449185 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1447/2896] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:13.380233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=34 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:13.443823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=9 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:18.439788 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:18.440319 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:18.440423 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:18.460211 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] MFA Rules not processed for user `396eaff430de42cf921ae7c2c87c645c`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:18.461443 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:18.517017 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1450/2897] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:09:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:28.509812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=25 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:33.445491 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2ed0-7814-4404-8832-a2b17921205f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:33.446114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2ed0-7814-4404-8832-a2b17921205f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:33.446114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f2ed0-7814-4404-8832-a2b17921205f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:33.467447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-ca1f2ed0-7814-4404-8832-a2b17921205f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:33.468769 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ca1f2ed0-7814-4404-8832-a2b17921205f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:33.476760 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1448/2898] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:33.490615 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:33.503633 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ef189-b770-4055-a86f-2ada26a09829 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:33.509219 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:33.509819 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:33.510103 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:33.510376 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:33.518908 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:33.520602 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:33.530494 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1451/2899] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:36.934143 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f25d5-79ef-450d-a9ed-695310101505 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:36.934712 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f25d5-79ef-450d-a9ed-695310101505 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:36.934824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f25d5-79ef-450d-a9ed-695310101505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:36.956476 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-239f25d5-79ef-450d-a9ed-695310101505 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:36.957710 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-239f25d5-79ef-450d-a9ed-695310101505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:36.965436 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1449/2900] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:36.978948 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:36.990183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79823f65-50ff-42df-ac5a-ab1096b4783b service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:36.995646 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:36.996812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:36.996812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:36.996812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:37.005619 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:37.007188 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:37.017222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1452/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:39.856529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d537-6531-4cc8-a941-80221b15f836 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:39.857002 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d537-6531-4cc8-a941-80221b15f836 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:39.857113 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210d537-6531-4cc8-a941-80221b15f836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:39.876962 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-f210d537-6531-4cc8-a941-80221b15f836 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:39.878161 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f210d537-6531-4cc8-a941-80221b15f836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:39.886145 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1450/2902] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:39.902987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:39.914675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8856e-3717-4377-9b9a-43a37e37f255 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:39.920433 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:39.921034 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:39.921314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:39.921588 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:39.929963 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:39.934344 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:39.941397 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1453/2903] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:43.058766 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed61de1-4bca-417f-b763-28f2587e9867 None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:43.059253 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed61de1-4bca-417f-b763-28f2587e9867 None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:43.059354 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed61de1-4bca-417f-b763-28f2587e9867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:43.079863 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-eed61de1-4bca-417f-b763-28f2587e9867 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:43.081095 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-eed61de1-4bca-417f-b763-28f2587e9867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:43.088874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1451/2904] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:43.103795 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:43.115140 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed781ec-949e-48ed-bbe6-041ccc8d2da1 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:43.120785 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:43.121382 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:43.121668 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:43.121943 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:43.133010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:43.133010 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:43.142742 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1454/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:46.300856 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:46.301382 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:46.301536 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:46.322529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:09:46.323673 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:09:46.331793 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1452/2906] 10.222.0.64 () {58 vars in 1016 bytes} [Fri Sep 23 14:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:09:46.346514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:09:46.357704 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f23d4-d23f-441b-b095-e5261bd4503f service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:09:46.363638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:09:46.364299 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:09:46.364582 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:09:46.365483 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:09:46.374367 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:09:46.375987 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:09:46.386239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1455/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:09:56.316269 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=15 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:09:56.381085 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=30 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:17.107773 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:17.109612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:17.121627 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53c519-ad88-41e1-b38e-9c3485dbea7b None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:17.126836 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:17.127464 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:17.127824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:17.128073 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] PATH_INFO: `/v3/users/396eaff430de42cf921ae7c2c87c645c` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:17.129148 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=396eaff430de42cf921ae7c2c87c645c)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:17.131071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:17.332070 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396eaff430de42cf921ae7c2c87c645c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.409612 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396eaff430de42cf921ae7c2c87c645c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.410222 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396eaff430de42cf921ae7c2c87c645c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.410853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396eaff430de42cf921ae7c2c87c645c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.418166 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ded3ea10-fe73-4279-b197-40d51fc9c7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396eaff430de42cf921ae7c2c87c645c'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.436853 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1453/2908] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:10:17 2022] DELETE /identity/v3/users/396eaff430de42cf921ae7c2c87c645c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:10:17.688224 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:17.699867 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e22ece-a1ee-4b88-9dd8-80529e844ee4 service nova] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:17.758514 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:17.759255 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:17.759548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:17.759821 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] PATH_INFO: `/v3/projects/55605cf56d48462587bd9c470502d448` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:17.760979 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55605cf56d48462587bd9c470502d448)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:17.762913 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:17.867361 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55605cf56d48462587bd9c470502d448', 'request_id': 'req-3d4a0ecb-a847-401c-87af-b91048cdc184'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.872851 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55605cf56d48462587bd9c470502d448', 'request_id': 'req-3d4a0ecb-a847-401c-87af-b91048cdc184'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.963617 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55605cf56d48462587bd9c470502d448', 'request_id': 'req-3d4a0ecb-a847-401c-87af-b91048cdc184'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.976021 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] The token cache is being invalidate because project 55605cf56d48462587bd9c470502d448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:10:17.980262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.980262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-3d4a0ecb-a847-401c-87af-b91048cdc184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:10:17.980262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1456/2909] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:10:17 2022] DELETE /identity/v3/projects/55605cf56d48462587bd9c470502d448 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:10:17.983423 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:17.983708 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:17.984040 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.003472 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:18.004700 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:18.062188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1454/2910] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:18.069607 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.069896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.070171 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.090381 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:18.091741 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:18.100291 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1457/2911] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:18.104545 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.114110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a479235-6648-42f1-adb5-f1386e69df9f None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.118645 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.119243 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.119526 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.119801 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.120482 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81864) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 23 14:10:18.120791 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.122384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.133762 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1455/2912] 10.222.0.48 () {58 vars in 1153 bytes} [Fri Sep 23 14:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 23 14:10:18.137823 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.147325 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013dcdf7-c5fc-4206-89eb-90c8062a5a53 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.151973 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.152634 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.152921 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.153189 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.153818 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.156353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.251183 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1458/2913] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:10:18 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:10:18.255417 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.267158 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57c303-05b4-459b-a12a-63b7a92c3b54 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.322574 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.323268 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.323587 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.323900 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.324606 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.326953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.335527 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:18.405916 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1456/2914] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:10:18 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:10:18.410165 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.420688 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec01c7f-cf4e-4532-8641-b9132929a5e9 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.425384 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.426014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.426296 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.426595 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.427239 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.428896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.439301 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1459/2915] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:10:18.443214 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.454121 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468cb8d-9e5d-4b02-92d1-9955e314f30d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.458754 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.459389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.459668 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.459960 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] PATH_INFO: `/v3/roles` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.460610 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.462202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae478-d1d1-4b1d-b85f-f470b897f21b admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.473114 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1457/2916] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:10:18.477157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.487157 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392e4f1-76c4-42a2-83c4-1d8113e59f1b admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.491755 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.492429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.492711 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.492983 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] PATH_INFO: `/v3/projects/dad73043c01d468cae0a49ae57bbe9b6/users/db10174b4c2848f59b832ef73b787228/roles/fa11e4e77f274fcfb93ddc58eaf4afd5` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.507690 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad73043c01d468cae0a49ae57bbe9b6, user_id=db10174b4c2848f59b832ef73b787228, role_id=fa11e4e77f274fcfb93ddc58eaf4afd5)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.510318 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.577136 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1460/2917] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:10:18 2022] PUT /identity/v3/projects/dad73043c01d468cae0a49ae57bbe9b6/users/db10174b4c2848f59b832ef73b787228/roles/fa11e4e77f274fcfb93ddc58eaf4afd5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:10:18.582677 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb344-366b-4e73-85ba-3b85d492221d None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.582994 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb344-366b-4e73-85ba-3b85d492221d None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.583265 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562eb344-366b-4e73-85ba-3b85d492221d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.602069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-562eb344-366b-4e73-85ba-3b85d492221d None None] MFA Rules not processed for user `858f2104639a431f8850986398647589`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:18.603270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-562eb344-366b-4e73-85ba-3b85d492221d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:18.660129 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1458/2918] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:18.669605 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:18.671813 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:18.693699 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:18.749934 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbdac4-12b1-4986-8edc-d6a1cb44c668 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:18.753609 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:18.754243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:18.754523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:18.754798 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:18.767372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:18.767372 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:18.774957 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1461/2919] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:10:23.775364 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342533-3079-400d-9fb6-57d78d24795a None None] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:23.775912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342533-3079-400d-9fb6-57d78d24795a None None] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:23.775912 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342533-3079-400d-9fb6-57d78d24795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:23.806563 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.auth.core [None req-21342533-3079-400d-9fb6-57d78d24795a None None] MFA Rules not processed for user `db10174b4c2848f59b832ef73b787228`. Rule list: `[]` (Enabled: `True`). {{(pid=81864) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:23.807905 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-21342533-3079-400d-9fb6-57d78d24795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:23.882324 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1459/2920] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:23.883477 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:23.894304 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02220-a864-4390-8af6-8395d1dc6be8 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:23.900327 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:23.900927 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:23.901403 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:23.901675 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:23.902314 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:23.904277 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.007261 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1462/2921] 10.222.0.48 () {60 vars in 1153 bytes} [Fri Sep 23 14:10:23 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 23 14:10:24.011367 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342533-3079-400d-9fb6-57d78d24795a None None] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:24.022790 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342533-3079-400d-9fb6-57d78d24795a None None] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:24.078456 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:24.079068 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] REQUEST_METHOD: `POST` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:24.079346 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:24.079615 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] PATH_INFO: `/v3/users` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:24.080312 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:24.082270 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.161575 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:24.167824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1460/2922] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Sep 23 14:10:24 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 23 14:10:24.171638 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:24.182014 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc1026-f7d8-45d7-86b1-69c085e63f29 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:24.186618 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:24.187226 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:24.187508 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:24.187780 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:24.188460 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:24.190060 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.200458 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1463/2923] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:10:24.205503 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:24.215592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eac736-fee8-475f-8b8d-09db2e26c0dc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:24.220893 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:24.221573 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:24.221851 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:24.222125 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] PATH_INFO: `/v3/projects/3116d28e01554b7ca3c6c4828861dbdf/users/716b2e7a8c474aebb9f7f991502aab5a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:24.237465 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3116d28e01554b7ca3c6c4828861dbdf, user_id=716b2e7a8c474aebb9f7f991502aab5a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:24.240173 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.317558 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1461/2924] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:10:24 2022] PUT /identity/v3/projects/3116d28e01554b7ca3c6c4828861dbdf/users/716b2e7a8c474aebb9f7f991502aab5a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:10:24.321839 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:24.334354 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56730507-48ae-4389-8e1e-7c2ada77c769 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:24.393652 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:24.394273 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:24.394556 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:24.394830 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:24.395478 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:24.397192 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5bfb3a-783e-4c49-b8e2-4b94dbc40a30 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.407465 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1464/2925] 10.222.0.48 () {58 vars in 1122 bytes} [Fri Sep 23 14:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 23 14:10:24.416101 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:24.427351 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518cb9c-3ba7-4af1-b0bd-10a457346f19 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:24.433940 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:24.434694 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:24.435053 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:24.435343 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] PATH_INFO: `/v3/projects/3116d28e01554b7ca3c6c4828861dbdf/users/716b2e7a8c474aebb9f7f991502aab5a/roles/0dadbccfa43b4e9fb658d0386627fc21` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:24.438310 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3116d28e01554b7ca3c6c4828861dbdf, user_id=716b2e7a8c474aebb9f7f991502aab5a, role_id=0dadbccfa43b4e9fb658d0386627fc21)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:24.441203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:24.453301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1462/2926] 10.222.0.48 () {60 vars in 1483 bytes} [Fri Sep 23 14:10:24 2022] PUT /identity/v3/projects/3116d28e01554b7ca3c6c4828861dbdf/users/716b2e7a8c474aebb9f7f991502aab5a/roles/0dadbccfa43b4e9fb658d0386627fc21 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:10:29.711074 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3876b3-2de2-45e4-bb8a-dd2305966213 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:29.711548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3876b3-2de2-45e4-bb8a-dd2305966213 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:29.711647 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3876b3-2de2-45e4-bb8a-dd2305966213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:29.742942 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-7b3876b3-2de2-45e4-bb8a-dd2305966213 None None] MFA Rules not processed for user `716b2e7a8c474aebb9f7f991502aab5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:29.744233 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-7b3876b3-2de2-45e4-bb8a-dd2305966213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:29.807338 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:29.827467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1465/2927] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:29.839779 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:29.841751 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:29.911264 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c8de0-1c75-41ff-a43d-2de1c117d8fc admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:29.915255 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:29.915586 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:29.915869 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:29.916333 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:29.980478 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:29.981977 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:29.992945 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1463/2928] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:10:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:10:30.281105 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8cd7-87f2-40eb-afb1-6ae742213553 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:30.281467 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8cd7-87f2-40eb-afb1-6ae742213553 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:30.281812 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8cd7-87f2-40eb-afb1-6ae742213553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:30.314243 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-81ac8cd7-87f2-40eb-afb1-6ae742213553 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:30.315459 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-81ac8cd7-87f2-40eb-afb1-6ae742213553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:30.374661 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1466/2929] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:30.508661 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:30.510063 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:30.586979 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de86a9e-861b-49ca-91f0-c3371f238be8 service glance] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:30.592001 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:30.592637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:30.592927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:30.593200 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:30.601795 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:30.603389 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:30.616301 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1464/2930] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:10:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:10:40.367216 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=34 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:40.608831 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:40.770265 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:40.770566 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:40.770840 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:40.789872 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] MFA Rules not processed for user `db10174b4c2848f59b832ef73b787228`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:40.791084 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:40.798696 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1467/2931] 10.222.0.48 () {58 vars in 958 bytes} [Fri Sep 23 14:10:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:40.835747 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:40.845517 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d2aec-c47b-4888-bfa1-71c3b185713a service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:40.849071 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6621711a3aa475fad33e482bd096989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:40.849659 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:40.849927 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:40.850202 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:40.851909 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:40.921956 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:40.923316 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:40.934378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1465/2932] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:10:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:10:41.563528 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:41.564218 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:41.565664 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:41.619841 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a75548-04c4-4aef-8c1a-b426a4ffbae9 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:41.623584 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:41.624712 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:41.624990 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:41.625262 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:41.627013 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:41.634738 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c17f-38d5-4350-b7fa-7b584bb9751e service glance] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:41.641337 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:41.644554 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:41.644702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:41.644702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:41.644702 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:41.644969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df877bae-bffe-401b-b58e-9d73a57952c3 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:41.645069 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:41.654358 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1468/2933] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:10:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:10:41.656855 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:41.658454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:41.669188 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1466/2934] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:10:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 23 14:10:44.500695 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:44.501191 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:44.501428 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:44.552054 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:10:44.553389 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:10:44.570343 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1469/2935] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Sep 23 14:10:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:10:44.583521 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:10:44.595332 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f05ad8-481a-481b-b579-ade2ba797c45 service placement] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:10:44.600355 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:10:44.601067 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:10:44.601359 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:10:44.601636 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:10:44.610447 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:10:44.612077 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:10:44.620637 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1467/2936] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:10:54.567334 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=47 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:10:54.616847 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=72 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:05.396523 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:11:05.406153 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a468e9-f4c5-4260-a365-c11b667d2912 None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:11:05.409758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:11:05.410353 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:11:05.410628 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:11:05.410896 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:11:05.420061 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:11:05.421487 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:11:05.430802 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1470/2937] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:11:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:11:07.564122 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:11:07.574319 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1aa439-6dac-4141-a10a-55ccda51c63e service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:11:07.579279 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd222074760c44210aea4b01f334238ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:11:07.579485 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:11:07.581926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:11:07.581926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:11:07.581926 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:11:07.592433 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:11:07.593908 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:11:07.602544 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1468/2938] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:11:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:11:15.426627 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=6 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:11:17.598496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=6 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:24.160279 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:24.162548 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:24.188064 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fc356-1cde-4454-b0a1-db602814f537 service neutron] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:24.195452 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:24.196341 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:24.196831 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:24.197346 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:24.199328 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:24.213737 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:24.215680 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5840c55-69b8-4b5e-a34b-e72f07f6d2ee service nova] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:24.241801 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1471/2939] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:12:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:12:25.314643 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:25.329426 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e59cce-45ea-414c-8de7-a269cc790d80 service neutron] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:25.335074 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ea62ee4cea94e3f941b4301885469ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:25.335823 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:25.336224 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:25.336592 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:25.338859 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:25.353450 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:25.355327 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:25.367967 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1469/2940] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:12:32.037513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] REQUEST_METHOD: `POST` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:32.037997 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:32.038391 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:32.058904 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.auth.core [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] MFA Rules not processed for user `d0350bfa0d3f4b83921843e91cff8efb`. Rule list: `[]` (Enabled: `True`). {{(pid=81863) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 23 14:12:32.060144 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:32.067861 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1472/2941] 10.222.0.48 () {58 vars in 967 bytes} [Fri Sep 23 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 23 14:12:32.111187 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:32.135496 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7575-816a-4344-9b51-1348bf32530a service nova] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:32.137378 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e30835b6a01b456bb97d745ad0052a0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:32.137975 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:32.138256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:32.138529 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:32.147667 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:32.149284 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:32.157384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1470/2942] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Sep 23 14:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 23 14:12:36.460624 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:36.474971 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666e66-eaa1-42e4-92cb-d6619767f9ec None None] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:36.479999 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:36.480789 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] REQUEST_METHOD: `GET` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:36.481230 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:36.481511 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:36.483272 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:36.495824 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:36.497551 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:36.512914 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1473/2943] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:12:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:12:39.967651 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:40.029770 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eedf3-2175-4828-8778-be291c331f89 service swift] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:40.034198 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:40.034824 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:40.035110 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:40.035384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] PATH_INFO: `/v3/users/db10174b4c2848f59b832ef73b787228` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:40.037177 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db10174b4c2848f59b832ef73b787228)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:40.039092 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:40.228085 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db10174b4c2848f59b832ef73b787228'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.310203 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db10174b4c2848f59b832ef73b787228'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.310797 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db10174b4c2848f59b832ef73b787228'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.311408 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db10174b4c2848f59b832ef73b787228'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.319546 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db10174b4c2848f59b832ef73b787228'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.337633 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1471/2944] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:12:39 2022] DELETE /identity/v3/users/db10174b4c2848f59b832ef73b787228 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:12:40.575259 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:40.586858 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10992e48-7b1d-46c7-849e-82da911c6cbe service placement] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:40.643041 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:40.643666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:40.643969 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:40.644246 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] PATH_INFO: `/v3/projects/dad73043c01d468cae0a49ae57bbe9b6` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:40.645349 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad73043c01d468cae0a49ae57bbe9b6)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:40.647283 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:40.756758 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad73043c01d468cae0a49ae57bbe9b6', 'request_id': 'req-11e392cc-de30-479d-9660-ff070620c2d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.762530 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad73043c01d468cae0a49ae57bbe9b6', 'request_id': 'req-11e392cc-de30-479d-9660-ff070620c2d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.835580 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad73043c01d468cae0a49ae57bbe9b6', 'request_id': 'req-11e392cc-de30-479d-9660-ff070620c2d8'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.846651 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] The token cache is being invalidate because project dad73043c01d468cae0a49ae57bbe9b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:12:40.846939 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.847557 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:40.849073 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1474/2945] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:12:40 2022] DELETE /identity/v3/projects/dad73043c01d468cae0a49ae57bbe9b6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:12:40.853144 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:40.854579 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:40.867877 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7e62d-55f9-4fc8-b287-ae2e8b2e6390 admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:40.908460 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:40.923112 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:40.923737 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:40.924075 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:40.924350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] PATH_INFO: `/v3/users/716b2e7a8c474aebb9f7f991502aab5a` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:40.925462 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] RBAC: Authorizing `identity:delete_user(user_id=716b2e7a8c474aebb9f7f991502aab5a)` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:40.927953 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:41.087384 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716b2e7a8c474aebb9f7f991502aab5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.149646 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716b2e7a8c474aebb9f7f991502aab5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.150256 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716b2e7a8c474aebb9f7f991502aab5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.150860 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716b2e7a8c474aebb9f7f991502aab5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.157917 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.notifications [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716b2e7a8c474aebb9f7f991502aab5a'} {{(pid=81864) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.175318 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1472/2946] 10.222.0.48 () {58 vars in 1224 bytes} [Fri Sep 23 14:12:40 2022] DELETE /identity/v3/users/716b2e7a8c474aebb9f7f991502aab5a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:12:41.437417 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Authenticating user token {{(pid=81863) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:12:41.438970 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.fernet_utils [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81863) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:12:41.452007 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e392cc-de30-479d-9660-ff070620c2d8 admin admin] Validating token access rules against request {{(pid=81863) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:12:41.505388 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:41.511109 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '858f2104639a431f8850986398647589', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9de1115a66a14d16b7a8fe9cccd73591', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81863) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:12:41.511735 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:12:41.512053 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:12:41.512324 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] PATH_INFO: `/v3/projects/3116d28e01554b7ca3c6c4828861dbdf` {{(pid=81863) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:12:41.513429 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3116d28e01554b7ca3c6c4828861dbdf)` {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:12:41.515402 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] RBAC: Authorization granted {{(pid=81863) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:12:41.612666 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3116d28e01554b7ca3c6c4828861dbdf', 'request_id': 'req-2d5e3c54-6793-40a3-9d79-07013f99e450'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.618222 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3116d28e01554b7ca3c6c4828861dbdf', 'request_id': 'req-2d5e3c54-6793-40a3-9d79-07013f99e450'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.679398 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3116d28e01554b7ca3c6c4828861dbdf', 'request_id': 'req-2d5e3c54-6793-40a3-9d79-07013f99e450'} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.690513 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] The token cache is being invalidate because project 3116d28e01554b7ca3c6c4828861dbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81863) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 23 14:12:41.690733 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.691375 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG keystone.notifications [None req-2d5e3c54-6793-40a3-9d79-07013f99e450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81863) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 23 14:12:41.693220 dv-cinder-857434-4-smb devstack@keystone.service[81863]: [pid: 81863|app: 0|req: 1475/2947] 10.222.0.48 () {58 vars in 1233 bytes} [Fri Sep 23 14:12:41 2022] DELETE /identity/v3/projects/3116d28e01554b7ca3c6c4828861dbdf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 23 14:12:51.171840 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:12:51.694413 dv-cinder-857434-4-smb devstack@keystone.service[81863]: DEBUG dbcounter [-] [81863] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81863) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 14:13:37.174438 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Authenticating user token {{(pid=81864) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 23 14:13:37.175874 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:13:37.244454 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df221b37-d6ff-4f68-88af-8147f5b7205d admin admin] Validating token access rules against request {{(pid=81864) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 23 14:13:37.302266 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4590313e50ef4de6b2d6a54467b13a12', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0309a7534d124324bb6a3a964e804ba5', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81864) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 23 14:13:37.302802 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] REQUEST_METHOD: `GET` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 23 14:13:37.303076 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] SCRIPT_NAME: `/identity` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 23 14:13:37.303350 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81864) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 23 14:13:37.305106 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.fernet_utils [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81864) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 23 14:13:37.316020 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 23 14:13:37.317605 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818c3e06-ea89-4907-9d72-56f6bb196b62 service placement] RBAC: Authorization granted {{(pid=81864) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 23 14:13:37.327338 dv-cinder-857434-4-smb devstack@keystone.service[81864]: [pid: 81864|app: 0|req: 1473/2948] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Sep 23 14:13:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 23 14:13:47.323130 dv-cinder-857434-4-smb devstack@keystone.service[81864]: DEBUG dbcounter [-] [81864] Writing DB stats keystone:SELECT=58 {{(pid=81864) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}